WorkTimeInSeconds,Input.id,Input.question,Input.predicted,Input.model,Answer.answer.on,Answer.comments,Answer.malformed.on,Answer.noanswer.on,Approve,Reject
18,1_1,What is a physician's assistant?,"A physician assistant is a person who has successfully completed an accredited education program for physician assistant, is licensed by the state and is practicing within the scope of that license.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,NICE,false,false,,
20,1_1,What is a physician's assistant?,A physician's assistant (PA) is a medical assistant who works under the supervision of a physician and is licensed to practice medicine in the state in which the patient resides.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
83,1_1,What is a physician's assistant?,A physician's assistant (PA) is a medical assistant.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
31,1_1,What is a physician's assistant?,A physician's assistant is a person who assists a physician in the performance of his or her duties.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,It is very interesting to the survey.,false,false,,
56,1_1,What is a physician's assistant?,"A physician's assistant (PA) is a medical assistant who works for a supervising physician who is responsible for patients, cared for by the physician assistant.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,It's really interesting,false,false,,
32,1_1,What is a physician's assistant?,A physician assistant is a medical professional who assists a doctor in the diagnosis and treatment of a patient.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,good,false,false,,
37,1_1,What is a physician's assistant?,A physician assistant is a medical professional who assists a doctor in the diagnosis and treatment of a patient.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
24,1_1,What is a physician's assistant?,A physician's assistant is a medical assistant.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
36,1_1,What is a physician's assistant?,A physician's assistant is a medical assistant.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
50,1_1,What is a physician's assistant?,A physician's assistant is a medical professional who provides medical care to patients.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
33,1_1,What is a physician's assistant?,A physician's assistant is a medical professional who provides medical care to patients.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,1_1,What is a physician's assistant?,A physician's assistant (PA) is a medical professional who provides medical care for patients.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
64,1_1,What is a physician's assistant?,A physician's assistant (PA) is a medical professional who provides medical care for patients.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
35,1_1,What is a physician's assistant?,A physician's assistant is a person who assists a physician in the administration of medical procedures.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
32,1_1,What is a physician's assistant?,A physician's assistant is a person who assists a physician in the administration of medical procedures.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,this is very nice,false,false,,
87,1_1,What is a physician's assistant?,a physician's assistant (ad) is a person—typically a youth—who provides,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,It is really interesting,true,false,correct answer,
47,1_1,What is a physician's assistant?,a physician's assistant (ad) is a person—typically a youth—who provides,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,absolutely correct,false,false,random answer,
14,1_1,What is a physician's assistant?,A physician's assistant (PA) is a medical assistant who works under the direct supervision of a physician and is licensed to practice medicine in the state in which the patient resides.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
30,1_1,What is a physician's assistant?,A physician's assistant (PA) is a medical assistant who works under the direct supervision of a physician and is licensed to practice medicine in the state in which the patient resides.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
23,1_10,Is a physician assistants above a nurse practitioner?,"A physician assistant is a person who has successfully completed an accredited education program for physician assistant, is licensed by the state and is practicing within the scope of that license.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
14,1_10,Is a physician assistants above a nurse practitioner?,"A physician assistant is a person who has successfully completed an accredited education program for physician assistant, is licensed by the state and is practicing within the scope of that license.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
14,1_10,Is a physician assistants above a nurse practitioner?,A physician's assistant is a nurse practitioner who has completed a one-year post-graduate program in nursing.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
33,1_10,Is a physician assistants above a nurse practitioner?,A physician's assistant is a nurse practitioner who has completed a one-year post-graduate program in nursing.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,1_10,Is a physician assistants above a nurse practitioner?,physician assistants are licensed medical professionals who may work independently of the lead physician,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
14,1_10,Is a physician assistants above a nurse practitioner?,physician assistants are licensed medical professionals who may work independently of the lead physician,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,good,false,false,,
37,1_10,Is a physician assistants above a nurse practitioner?,A physician assistant is a medical assistant who is not a nurse practitioner.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
21,1_10,Is a physician assistants above a nurse practitioner?,A physician assistant is a medical assistant who is not a nurse practitioner.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,random answer,
14,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician's assistant in the UK is £15,000.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
27,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician's assistant in the UK is £15,000.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
50,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician's assistant in the UK is £16,000.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician's assistant in the UK is £16,000.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
23,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is £20,000.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is £20,000.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
60,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is around £60,000 a year.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
79,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is around £60,000 a year.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is £60,000.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
60,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is £60,000.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician's assistant in the UK is £28,000.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician's assistant in the UK is £28,000.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is £20,000 a year.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,1_4,What's the average starting salary for a physician's assistant in the UK?,"The average starting salary for a physician assistant in the UK is £20,000 a year.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
21,1_9,Do nurse practitioners or physician assistants make more?,"On average, nurse practitioners and physician assistants make more than nurse practitioners. The BLS reports that the median annual wage for nurse practitioners was $109,820 as of May 2019.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,1_9,Do nurse practitioners or physician assistants make more?,"On average, nurse practitioners and physician assistants make more than nurse practitioners. The BLS reports that the median annual wage for nurse practitioners was $109,820 as of May 2019.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,1_9,Do nurse practitioners or physician assistants make more?,"The average salary for a nurse practitioner is $65,000. The average salary for a physician's assistant is $30,000.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,1_9,Do nurse practitioners or physician assistants make more?,"The average salary for a nurse practitioner is $65,000. The average salary for a physician's assistant is $30,000.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
26,1_9,Do nurse practitioners or physician assistants make more?,"the bls reports that the median annual wage for nurse practitioners was $ 109, 820 as of may 2019, while the median annual wage for physician assistants reached $ 112, 260 during the same month",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
48,1_9,Do nurse practitioners or physician assistants make more?,"the bls reports that the median annual wage for nurse practitioners was $ 109, 820 as of may 2019, while the median annual wage for physician assistants reached $ 112, 260 during the same month",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,random answer,
39,1_9,Do nurse practitioners or physician assistants make more?,"The BLS reports that the median annual wage for nurse practitioners was $109,820 as of May 2019 while the median annual wage for physician assistants reached $112,260 during the same month.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,1_9,Do nurse practitioners or physician assistants make more?,"The BLS reports that the median annual wage for nurse practitioners was $109,820 as of May 2019 while the median annual wage for physician assistants reached $112,260 during the same month.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,100_5,did Kevin Durant win any awards?,Kevin Durant was named NBA Finals MVP.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,100_5,did Kevin Durant win any awards?,Kevin Durant was named NBA Finals MVP.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,100_5,did Kevin Durant win any awards?,"Kevin Durant is a two-time NBA Finals MVP, a four-time scoring champion, and a two-time Olympic gold medalist.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,100_5,did Kevin Durant win any awards?,"Kevin Durant is a two-time NBA Finals MVP, a four-time scoring champion, and a two-time Olympic gold medalist.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,100_5,did Kevin Durant win any awards?,"Kevin Durant has won four NBA MVP Awards, two NBA Finals MVP Awards, two NBA All-Star Games MVP Awards, and two NBA Player of the Year Awards.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
33,100_5,did Kevin Durant win any awards?,"Kevin Durant has won four NBA MVP Awards, two NBA Finals MVP Awards, two NBA All-Star Games MVP Awards, and two NBA Player of the Year Awards.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,100_5,did Kevin Durant win any awards?,Kevin Durant won the NBA MVP award for the second year in a row.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,100_5,did Kevin Durant win any awards?,Kevin Durant won the NBA MVP award for the second year in a row.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,101_5,How did the single The One You Slip Around With by Jan Howard do?,The single The One You Slip Around With by Jan Howard peaked at number 13 on the Billboard country music chart and earning her several Most Promising Female awards.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,101_5,How did the single The One You Slip Around With by Jan Howard do?,The single The One You Slip Around With by Jan Howard peaked at number 13 on the Billboard country music chart and earning her several Most Promising Female awards.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,101_5,How did the single The One You Slip Around With by Jan Howard do?,"The One You Slip Around With by Jan Howard was Howard's first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several awards.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,101_5,How did the single The One You Slip Around With by Jan Howard do?,"The One You Slip Around With by Jan Howard was Howard's first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several awards.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
26,101_5,How did the single The One You Slip Around With by Jan Howard do?,Jan Howard's single The One You Slip Around With peaked at number 13 on the Billboard country music chart and earning her several Most Promising Female awards.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,101_5,How did the single The One You Slip Around With by Jan Howard do?,Jan Howard's single The One You Slip Around With peaked at number 13 on the Billboard country music chart and earning her several Most Promising Female awards.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
112,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,"Jan Howard's single The One You Slip Around With was her first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several Most Promising Female Vocalist awards (over another newcomer named Loretta Lynn).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,"Jan Howard's single The One You Slip Around With was her first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several Most Promising Female Vocalist awards (over another newcomer named Loretta Lynn).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,Jan Howard's single The One You Slip Around with was nominated for a Grammy Award for Best Female Country Vocal Performance.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,Jan Howard's single The One You Slip Around with was nominated for a Grammy Award for Best Female Country Vocal Performance.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,"Jan Howard's single The One You Slip Around With was her first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several Most Promising Female Vocalist awards.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,"Jan Howard's single The One You Slip Around With was her first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several Most Promising Female Vocalist awards.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
21,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,"The One You Slip Around With was Jan Howard's first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several Most Promising Female Vocalist awards.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
27,101_6,Did Jan Howard get any reviews or awards for her single The One You Slip Around With?,"The One You Slip Around With was Jan Howard's first significant country hit, hitting the top 15, peaking at number 13 on the Billboard country music chart and earning her several Most Promising Female Vocalist awards.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,104_5,When did they begin recording as the Funk Brothers?,They began recording as the Funk Brothers in the early 1940s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,104_5,When did they begin recording as the Funk Brothers?,They began recording as the Funk Brothers in the early 1940s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording as the Funk Brothers in the late 1970s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording as the Funk Brothers in the late 1970s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers were a group of Detroit-based session musicians who performed the backing to most Motown recordings from 1959 until the company moved to Los Angeles in 1972.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
75,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers were a group of Detroit-based session musicians who performed the backing to most Motown recordings from 1959 until the company moved to Los Angeles in 1972.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
14,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers played on Motown recordings from 1959 until 1972.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers played on Motown recordings from 1959 until 1972.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
29,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording in Detroit in the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording in Detroit in the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording as the Funk Brothers in 1976.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
16,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording as the Funk Brothers in 1976.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
10,104_5,When did they begin recording as the Funk Brothers?,The 13 Funk Brothers began recording as the Funk Brothers in 1959.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,104_5,When did they begin recording as the Funk Brothers?,The 13 Funk Brothers began recording as the Funk Brothers in 1959.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording in the late 1970s and early 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,104_5,When did they begin recording as the Funk Brothers?,The Funk Brothers began recording in the late 1970s and early 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Compilation Soundtrack Album For Standing in the Shadows of Motown.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
9,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Compilation Soundtrack Album For Standing in the Shadows of Motown.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
11,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Compilation Soundtrack Album For A Motion Picture.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Compilation Soundtrack Album For A Motion Picture.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Soundtrack Album For Standing in the Shadows of Motown.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
13,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Soundtrack Album For Standing in the Shadows of Motown.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
14,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Soundtrack Album For A Motion Picture, Television Or Other Visual Media for Standing in the Shadows of Motown.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Soundtrack Album For A Motion Picture, Television Or Other Visual Media for Standing in the Shadows of Motown.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
20,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Soundtrack Album For A Motion Picture.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
4,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Soundtrack Album For A Motion Picture.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
59,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Compilation Soundtrack Album For A Motion Picture, Television Or Other Visual Media for Standing in the Shadows of Motown",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,104_7,Did The Funk Brothers receive any awards or honors?,"The Funk Brothers have received three Grammy awards: Lifetime Achievement Award in 2004 Best Traditional R&B Performance for What's Going On with Chaka Khan, 2002 Best Compilation Soundtrack Album For A Motion Picture, Television Or Other Visual Media for Standing in the Shadows of Motown",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
28,105_2,Was the 2014 release of No Place for Disgrace by Flotsam and Jetsam on time or delayed?,The band re-recorded the album in 2014 under the title No Place For Disgrace 2014.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
6,105_2,Was the 2014 release of No Place for Disgrace by Flotsam and Jetsam on time or delayed?,The band re-recorded the album in 2014 under the title No Place For Disgrace 2014.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
26,105_2,Was the 2014 release of No Place for Disgrace by Flotsam and Jetsam on time or delayed?,"No Place for Disgrace by Flotsam and Jetsam was released on February 18, 2014.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
5,105_2,Was the 2014 release of No Place for Disgrace by Flotsam and Jetsam on time or delayed?,"No Place for Disgrace by Flotsam and Jetsam was released on February 18, 2014.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,105_2,Was the 2014 release of No Place for Disgrace by Flotsam and Jetsam on time or delayed?,No Place for Disgrace by Flotsam and Jetsam was released on 24 February 2014.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
28,105_2,Was the 2014 release of No Place for Disgrace by Flotsam and Jetsam on time or delayed?,No Place for Disgrace by Flotsam and Jetsam was released on 24 February 2014.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,It doesn't answer whether it was on time or delayed.,false,true,,
14,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?",kaline became the 13th man in major league history to hit two home runs in the same inning,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
6,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?",kaline became the 13th man in major league history to hit two home runs in the same inning,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
31,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?",Al Kaline was the only player in the history of the American League to hit 20 home runs in a season.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?",Al Kaline was the only player in the history of the American League to hit 20 home runs in a season.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?","Al Kaline became the 13th man in major league history to hit two home runs in the same inning, became the youngest to hit three home runs in one game, and finished the year with 200 hits, 27 home runs and 102 RBIs.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?","Al Kaline became the 13th man in major league history to hit two home runs in the same inning, became the youngest to hit three home runs in one game, and finished the year with 200 hits, 27 home runs and 102 RBIs.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?","During the 1955 season, Al Kaline became the 13th man in major league history to hit two home runs in the same inning, became the youngest to hit three home runs in one game, and finished the year with 200 hits, 27 home runs and 102 RBIs.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?","During the 1955 season, Al Kaline became the 13th man in major league history to hit two home runs in the same inning, became the youngest to hit three home runs in one game, and finished the year with 200 hits, 27 home runs and 102 RBIs.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?","in 1955, al kaline became the 13th man in major league history to hit",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
22,108_3,"Were there other notable stats on Al Kaline's early years besides ending  the season with a .340 batting average, becoming the youngest player ever to win the American League batting title?","in 1955, al kaline became the 13th man in major league history to hit",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,The answer is incomplete.,true,false,,
17,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,The song Inside the Fire peaked at number one on the Billboard Mainstream Rock Tracks chart and number four on the Modern Rock Tracks chart.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
3,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,The song Inside the Fire peaked at number one on the Billboard Mainstream Rock Tracks chart and number four on the Modern Rock Tracks chart.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
19,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,"On March 24, 2008, Inside the Fire debuted on more than sixty radio stations, quickly showing up on many significant music charts and reaching number 73 on the Billboard Hot 100 chart, and number one on the Hot Mainstream Rock Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,"On March 24, 2008, Inside the Fire debuted on more than sixty radio stations, quickly showing up on many significant music charts and reaching number 73 on the Billboard Hot 100 chart, and number one on the Hot Mainstream Rock Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
20,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,"Inside the Fire debuted on more than sixty radio stations, quickly showing up on many significant music charts and reaching number 73 on the Billboard Hot 100 chart, and number one on the Hot Mainstream Rock Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,"Inside the Fire debuted on more than sixty radio stations, quickly showing up on many significant music charts and reaching number 73 on the Billboard Hot 100 chart, and number one on the Hot Mainstream Rock Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
34,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,"Inside the Fire debuted on more than sixty radio stations, quickly showing up on many significant music charts and reaching number 73 on the Billboard Hot 100 chart.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
20,111_3,Did the single  Inside the Fire from the album indestructible byt the band disturbed do well on the charts?,"Inside the Fire debuted on more than sixty radio stations, quickly showing up on many significant music charts and reaching number 73 on the Billboard Hot 100 chart.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,113_7,for how long was Narendra Modi prime minister?,Narendra Modi was prime minister of India for five years.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
7,113_7,for how long was Narendra Modi prime minister?,Narendra Modi was prime minister of India for five years.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,113_7,for how long was Narendra Modi prime minister?,Narendra Modi was prime minister from 2014 to 2019.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,113_7,for how long was Narendra Modi prime minister?,Narendra Modi was prime minister from 2014 to 2019.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,113_7,for how long was Narendra Modi prime minister?,Narendra Modi served as the 28th prime minister of India from 2014 to 2019.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,113_7,for how long was Narendra Modi prime minister?,Narendra Modi served as the 28th prime minister of India from 2014 to 2019.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,113_7,for how long was Narendra Modi prime minister?,narendra modi was prime minister from 30 may 2019 to 7 august 2019,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
10,113_7,for how long was Narendra Modi prime minister?,narendra modi was prime minister from 30 may 2019 to 7 august 2019,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
7,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is an American soul duo composed of singer-songwriter and musician Cee Lo Green and multi-instrumentalist, DJ and producer Danger Mouse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
38,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is an American soul duo composed of singer-songwriter and musician Cee Lo Green and multi-instrumentalist, DJ and producer Danger Mouse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
13,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is an American soul duo composed of singer-songwriter Cee Lo Green and multi-instrumentalist, DJ and producer Danger Mouse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is an American soul duo composed of singer-songwriter Cee Lo Green and multi-instrumentalist, DJ and producer Danger Mouse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
17,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is a music project of multi-instrumentalist, DJ and producer Danger Mouse and rapper / vocalist Cee Lo Green.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is a music project of multi-instrumentalist, DJ and producer Danger Mouse and rapper / vocalist Cee Lo Green.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
32,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley band name meaning Music project of multi-instrumentalist, DJ and producer Danger Mouse (New York) and rapper/ vocalist Cee Lo Green (Atlanta).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,true,false,,
8,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley band name meaning Music project of multi-instrumentalist, DJ and producer Danger Mouse (New York) and rapper/ vocalist Cee Lo Green (Atlanta).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,true,false,,
3,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is an American soul and alternative hip hop duo composed of singer-songwriter and producer Cee Lo Green and multi-instrumentalist, DJ and producer Danger Mouse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
24,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is an American soul and alternative hip hop duo composed of singer-songwriter and producer Cee Lo Green and multi-instrumentalist, DJ and producer Danger Mouse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,It doesn't state the name of the band.,false,true,,
21,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is a musical project of multi-instrumentalist, DJ and producer Danger Mouse and rapper / vocalist Cee Lo Green.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,118_1,what was Gnarls Barkley bands name?,"Gnarls Barkley is a musical project of multi-instrumentalist, DJ and producer Danger Mouse and rapper / vocalist Cee Lo Green.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,12_7,What is the success rate of LASIK?,The LASIK success rate – or LASIK outcomes – is well understood with literally thousands of clinical studies looking at visual acuity and patient satisfaction.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
98,12_7,What is the success rate of LASIK?,The LASIK success rate – or LASIK outcomes – is well understood with literally thousands of clinical studies looking at visual acuity and patient satisfaction.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,true,false,confusing answer,
22,12_7,What is the success rate of LASIK?,"The latest research reports 99 percent of patients achieve better than 20/40 vision and more than 90 percent achieve 20/20 or better. In addition, LAS",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
25,12_7,What is the success rate of LASIK?,"The latest research reports 99 percent of patients achieve better than 20/40 vision and more than 90 percent achieve 20/20 or better. In addition, LAS",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
5,12_7,What is the success rate of LASIK?,The latest research reports 99 percent of patients achieve better than 20/40 vision and more than 90 percent achieve 20/20 or better.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,12_7,What is the success rate of LASIK?,The latest research reports 99 percent of patients achieve better than 20/40 vision and more than 90 percent achieve 20/20 or better.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
76,12_7,What is the success rate of LASIK?,The latest research reports 99 percent of LASIK patients achieve better than 20/40 vision and more than 90 percent achieve 20/20 or better.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,12_7,What is the success rate of LASIK?,The latest research reports 99 percent of LASIK patients achieve better than 20/40 vision and more than 90 percent achieve 20/20 or better.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
85,121_10,Did Erich Ludendorff get permission for additional men when he lobbied in Reichstag?,[ 8 ] in 1913 funding was approved for four additional corps but ludendorff was transferred to regimental duties as commander of the 39th ( lower rhine ) fusiliers,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
4,121_10,Did Erich Ludendorff get permission for additional men when he lobbied in Reichstag?,[ 8 ] in 1913 funding was approved for four additional corps but ludendorff was transferred to regimental duties as commander of the 39th ( lower rhine ) fusiliers,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
21,121_10,Did Erich Ludendorff get permission for additional men when he lobbied in Reichstag?,"In 1913 funding was approved for four additional corps but Ludendorff was transferred to regimental duties as commander of the 39th (Lower Rhine) Fusiliers, stationed at Dsseldorf.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,121_10,Did Erich Ludendorff get permission for additional men when he lobbied in Reichstag?,"In 1913 funding was approved for four additional corps but Ludendorff was transferred to regimental duties as commander of the 39th (Lower Rhine) Fusiliers, stationed at Dsseldorf.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,121_10,Did Erich Ludendorff get permission for additional men when he lobbied in Reichstag?,In 1913 funding was approved for four additional corps but Ludendorff was transferred to regimental duties as commander of the 39th (Lower Rhine) Fusiliers.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,121_10,Did Erich Ludendorff get permission for additional men when he lobbied in Reichstag?,In 1913 funding was approved for four additional corps but Ludendorff was transferred to regimental duties as commander of the 39th (Lower Rhine) Fusiliers.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
23,123_2,Did Did Jack White plead guilty to the misdemeanor aggravated assault charge?,Jack White pleaded guilty to the misdemeanor aggravated assault charge.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,123_2,Did Did Jack White plead guilty to the misdemeanor aggravated assault charge?,Jack White pleaded guilty to the misdemeanor aggravated assault charge.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,123_2,Did Did Jack White plead guilty to the misdemeanor aggravated assault charge?,Jack White pleaded guilty to the lesser charge of assault and battery.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,123_2,Did Did Jack White plead guilty to the misdemeanor aggravated assault charge?,Jack White pleaded guilty to the lesser charge of assault and battery.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,123_2,Did Did Jack White plead guilty to the misdemeanor aggravated assault charge?,"In March 2004, Jack White plead guilty to assault and battery, was made to pay $750 (including court costs) and to attend anger management classes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
17,123_2,Did Did Jack White plead guilty to the misdemeanor aggravated assault charge?,"In March 2004, Jack White plead guilty to assault and battery, was made to pay $750 (including court costs) and to attend anger management classes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
16,128_1,What was Ronald Shannon Jackson's career?,Ronald Shannon Jackson was an American jazz drummer and bandleader who appeared on albums by Bill Laswell and The Decoding Society.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,128_1,What was Ronald Shannon Jackson's career?,Ronald Shannon Jackson was an American jazz drummer and bandleader who appeared on albums by Bill Laswell and The Decoding Society.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,128_1,What was Ronald Shannon Jackson's career?,Ronald Shannon Jackson was an American jazz drummer.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,128_1,What was Ronald Shannon Jackson's career?,Ronald Shannon Jackson was an American jazz drummer.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,128_1,What was Ronald Shannon Jackson's career?,Ronald Shannon Jackson was an American jazz drummer and bandleader.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,128_1,What was Ronald Shannon Jackson's career?,Ronald Shannon Jackson was an American jazz drummer and bandleader.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,13_1,What is tofu exactly?,Tofu is a soy-based food.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
98,13_1,What is tofu exactly?,Tofu is a soy-based food.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
105,13_1,What is tofu exactly?,Tofu is a type of soy sauce made from soy beans and rice.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
27,13_1,What is tofu exactly?,Tofu is a type of soy sauce made from soy beans and rice.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
43,13_1,What is tofu exactly?,Tofu is a food made from soybeans.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,13_1,What is tofu exactly?,Tofu is a food made from soybeans.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,13_2,How is tofu made?,"Tofu is made from soybeans that are ground in water, heated, and coagulated with minerals like calcium or magnesium salt.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,13_2,How is tofu made?,"Tofu is made from soybeans that are ground in water, heated, and coagulated with minerals like calcium or magnesium salt.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
27,13_2,How is tofu made?,Tofu is made from soybeans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
80,13_2,How is tofu made?,Tofu is made from soybeans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
35,13_2,How is tofu made?,Tofu is made from soy beans in a process similar to making cheese.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
117,13_2,How is tofu made?,Tofu is made from soy beans in a process similar to making cheese.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
37,13_2,How is tofu made?,"Made from soybeans, tofu is also known as bean curd.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
8,13_2,How is tofu made?,"Made from soybeans, tofu is also known as bean curd.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
11,13_2,How is tofu made?,"Tofu is made from soy beans in a process similar to making cheese. The soy milk is used and pressed into blocks of different textures, from soft to extra thick.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
27,13_2,How is tofu made?,"Tofu is made from soy beans in a process similar to making cheese. The soy milk is used and pressed into blocks of different textures, from soft to extra thick.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
31,13_2,How is tofu made?,"Tofu is made from soy beans in a process similar to making cheese. The soy milk is used and pressed into blocks of different textures, from soft to extra viscous.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
7,13_2,How is tofu made?,"Tofu is made from soy beans in a process similar to making cheese. The soy milk is used and pressed into blocks of different textures, from soft to extra viscous.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
8,13_2,How is tofu made?,"The traditional way to make tofu involves steam-treating the soybeans, adding soy sauce and water, and then drying the skins.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
39,13_2,How is tofu made?,"The traditional way to make tofu involves steam-treating the soybeans, adding soy sauce and water, and then drying the skins.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
20,13_2,How is tofu made?,Tofu is made by curdling soy milk.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,13_2,How is tofu made?,Tofu is made by curdling soy milk.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,13_2,How is tofu made?,"Tofu is usually made from soybean oil, soybean meal, or vegetable oil.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
116,13_2,How is tofu made?,"Tofu is usually made from soybean oil, soybean meal, or vegetable oil.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,13_2,How is tofu made?,Tofu is made from soy beans.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,confusing answer,
73,13_2,How is tofu made?,Tofu is made from soy beans.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,confusing answer,
22,13_6,Can I eat tofu raw?,You can eat tofu raw.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,good,false,false,,
14,13_6,Can I eat tofu raw?,You can eat tofu raw.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
25,13_6,Can I eat tofu raw?,The best type of tofu to be eaten in its raw form is the silken and soft block tofu.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
27,13_6,Can I eat tofu raw?,The best type of tofu to be eaten in its raw form is the silken and soft block tofu.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
80,13_6,Can I eat tofu raw?,can we eat tofu in its raw form? is it safe to eat raw tofu,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,correct answer,
13,13_6,Can I eat tofu raw?,can we eat tofu in its raw form? is it safe to eat raw tofu,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,random answer,
6,13_6,Can I eat tofu raw?,"yes, you can eat raw tofu",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
26,13_6,Can I eat tofu raw?,"yes, you can eat raw tofu",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
18,13_7,What are common ways to cook tofu?,Common ways to cook tofu include steaming or broiling.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
30,13_7,What are common ways to cook tofu?,Common ways to cook tofu include steaming or broiling.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
36,13_7,What are common ways to cook tofu?,"The most common ways to cook tofu are stir-frying, baking, grilling, and scrambling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,good,false,false,,
8,13_7,What are common ways to cook tofu?,"The most common ways to cook tofu are stir-frying, baking, grilling, and scrambling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,13_7,What are common ways to cook tofu?,"The most common methods for cooking extra-firm and firm tofu are pan-frying, stir-frying, baking, grilling, and scram",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
8,13_7,What are common ways to cook tofu?,"The most common methods for cooking extra-firm and firm tofu are pan-frying, stir-frying, baking, grilling, and scram",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
8,13_7,What are common ways to cook tofu?,"The most common methods for cooking tofu are stir-frying, baking, grilling, and scrambling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,13_7,What are common ways to cook tofu?,"The most common methods for cooking tofu are stir-frying, baking, grilling, and scrambling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
8,13_7,What are common ways to cook tofu?,"The most common methods to cook tofu are stir-frying, baking, and scrambling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
71,13_7,What are common ways to cook tofu?,"The most common methods to cook tofu are stir-frying, baking, and scrambling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
22,13_7,What are common ways to cook tofu?,The most common ways to cook tofu is by steaming or boiling.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
21,13_7,What are common ways to cook tofu?,The most common ways to cook tofu is by steaming or boiling.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,13_7,What are common ways to cook tofu?,there are many different ways to cook tofu. steamed or stir-fried is one,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
39,13_7,What are common ways to cook tofu?,there are many different ways to cook tofu. steamed or stir-fried is one,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
9,13_7,What are common ways to cook tofu?,"Cooking tofu is an ideal choice for pan-frying, stir-frying, baking, grilling, and scrambling.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,NA,false,false,,
6,13_7,What are common ways to cook tofu?,"Cooking tofu is an ideal choice for pan-frying, stir-frying, baking, grilling, and scrambling.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,13_8,In what cuisines is tofu popular?,Tofu is popular in Asian cuisine.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
39,13_8,In what cuisines is tofu popular?,Tofu is popular in Asian cuisine.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,13_8,In what cuisines is tofu popular?,"Tofu is eaten around the world, particularly in East Asia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,13_8,In what cuisines is tofu popular?,"Tofu is eaten around the world, particularly in East Asia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
23,13_8,In what cuisines is tofu popular?,Tofu is an extremely popular food in China over 2000 years and experts believe that it’s production began sometime during the Han dynasty (206-220BC).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
8,13_8,In what cuisines is tofu popular?,Tofu is an extremely popular food in China over 2000 years and experts believe that it’s production began sometime during the Han dynasty (206-220BC).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
115,13_8,In what cuisines is tofu popular?,Tofu is an extremely popular food throughout almost the all of Asia. Tofu was first used in China over 2000 years ago and experts believe that,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,"It should be ""almost all of Asia"" and sentence 2 is unfinished.",true,false,correct answer,
11,13_8,In what cuisines is tofu popular?,Tofu is an extremely popular food throughout almost the all of Asia. Tofu was first used in China over 2000 years ago and experts believe that,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
93,13_8,In what cuisines is tofu popular?,Tofu is an extremely popular food throughout almost all of Asia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
60,13_8,In what cuisines is tofu popular?,Tofu is an extremely popular food throughout almost all of Asia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
49,13_8,In what cuisines is tofu popular?,"In China, tofu is an extremely popular food throughout almost the all of Asia.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,13_8,In what cuisines is tofu popular?,"In China, tofu is an extremely popular food throughout almost the all of Asia.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
99,13_8,In what cuisines is tofu popular?,Asian cuisine is an extremely popular food throughout almost the all of Asia. Tofu is an extremely popular food throughout almost the all of Asia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,confusing answer,
59,13_8,In what cuisines is tofu popular?,Asian cuisine is an extremely popular food throughout almost the all of Asia. Tofu is an extremely popular food throughout almost the all of Asia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,confusing answer,
10,13_8,In what cuisines is tofu popular?,getty images tofu is an extremely popular food throughout almost the all of asia,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,correct answer,
64,13_8,In what cuisines is tofu popular?,getty images tofu is an extremely popular food throughout almost the all of asia,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,random answer,
53,13_8,In what cuisines is tofu popular?,"In Chinese cuisine, tofu is an extremely popular food throughout almost the all of Asia. Tofu was first used in China over 2000 years ago and experts believe that it's production began sometime during the Han dynasty (206-220BC).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,good,false,false,,
7,13_8,In what cuisines is tofu popular?,"In Chinese cuisine, tofu is an extremely popular food throughout almost the all of Asia. Tofu was first used in China over 2000 years ago and experts believe that it's production began sometime during the Han dynasty (206-220BC).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,13_9,Is tofu good for you?,"tofu is a good source of protein, calcium, iron, magnesium, and many other important nutrients.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
53,13_9,Is tofu good for you?,"tofu is a good source of protein, calcium, iron, magnesium, and many other important nutrients.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,good,false,false,,
38,13_9,Is tofu good for you?,Tofu is a good source of protein and contains all four essential amino acids. It is also a valuable plant source of iron and calcium and,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
50,13_9,Is tofu good for you?,Tofu is a good source of protein and contains all four essential amino acids. It is also a valuable plant source of iron and calcium and,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
34,13_9,Is tofu good for you?,"Tofu is a good source of protein. It's also a source of iron, calcium, magnesium, and potassium.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,good,false,false,,
6,13_9,Is tofu good for you?,"Tofu is a good source of protein. It's also a source of iron, calcium, magnesium, and potassium.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
29,13_9,Is tofu good for you?,Tofu is a good source of protein. It is also a good source of calcium.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,good,false,false,,
27,13_9,Is tofu good for you?,Tofu is a good source of protein. It is also a good source of calcium.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
27,13_9,Is tofu good for you?,"tofu is a popular source of calcium, iron, vitamin C, zinc, manganese, iron, vitamin B6, vitamin B12, vitamin B6, vitamin B12, vitamin B12, vitamin B6, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,true,false,correct answer,
14,13_9,Is tofu good for you?,"tofu is a popular source of calcium, iron, vitamin C, zinc, manganese, iron, vitamin B6, vitamin B12, vitamin B6, vitamin B12, vitamin B12, vitamin B6, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin B12, vitamin",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,malformed answer,
6,13_9,Is tofu good for you?,"Tofu is a good source of protein. It also contains minerals such as calcium, magnesium, iron, and potassium.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
43,13_9,Is tofu good for you?,"Tofu is a good source of protein. It also contains minerals such as calcium, magnesium, iron, and potassium.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
13,13_9,Is tofu good for you?,"Tofu is high in protein, which lowers your blood sugar and lowers your risk of diabetes. It also contains calcium, which lowers your risk of heart disease.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,13_9,Is tofu good for you?,"Tofu is high in protein, which lowers your blood sugar and lowers your risk of diabetes. It also contains calcium, which lowers your risk of heart disease.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
20,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,"Bob Fitzsimmons continued to hold his title, but did not lose it.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
8,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,"Bob Fitzsimmons continued to hold his title, but did not lose it.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
17,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,bob fitzsimmons retained the title by a knockout in round four,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
23,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,bob fitzsimmons retained the title by a knockout in round four,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
11,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,Bob Fitzsimmons continued to hold his title.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,Bob Fitzsimmons continued to hold his title.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,Bob Fitzsimmons continued to hold the heavy weight title until the end of his career.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,Bob Fitzsimmons continued to hold the heavy weight title until the end of his career.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,Bob Fitzsimmons won the Heavyweight title.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
10,131_2,Did Bob Fitzsimmons continue to hold his title or did he lose it?,Bob Fitzsimmons won the Heavyweight title.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
18,131_7,What happened once Jeffries wore Bob Fitzsimmons down?,but he kept going until his enormous strength and youth wore down bob and he knocked him out cold in round eight,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
25,131_7,What happened once Jeffries wore Bob Fitzsimmons down?,but he kept going until his enormous strength and youth wore down bob and he knocked him out cold in round eight,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,This isn't a complete answer.,true,false,,
11,131_7,What happened once Jeffries wore Bob Fitzsimmons down?,"With his nose and cheek broken, most would have sympathized with Jeffries had he quit, but he kept going until his enormous strength and youth wore down Bob and he knocked him out cold in round eight.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
8,131_7,What happened once Jeffries wore Bob Fitzsimmons down?,"With his nose and cheek broken, most would have sympathized with Jeffries had he quit, but he kept going until his enormous strength and youth wore down Bob and he knocked him out cold in round eight.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
22,131_7,What happened once Jeffries wore Bob Fitzsimmons down?,"With his nose and cheek bones broken, most would have sympathized with Jeffries had he quit, but he kept going until his enormous strength and youth wore down Bob and he knocked him out cold in round eight.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,131_7,What happened once Jeffries wore Bob Fitzsimmons down?,"With his nose and cheek bones broken, most would have sympathized with Jeffries had he quit, but he kept going until his enormous strength and youth wore down Bob and he knocked him out cold in round eight.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,132_2,What was the 1994–95 NHL lockout?,"Find sources: ""1994–95 NHL lockout"" – news · newspapers · books · scholar · JSTOR ( December 2014 ) ( Learn how and when to remove this template message ) National Hockey League labor relations 1992 strike 1994–95 lockout 2004–05 lockout 2012–13 lockout Collective Bargaining Agreement Ice hockey portal v t e The 1994–95 NHL lockout was a lockout that came after a year of National Hockey League (NHL) hockey that was played without a collective bargaining agreement .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
7,132_2,What was the 1994–95 NHL lockout?,"Find sources: ""1994–95 NHL lockout"" – news · newspapers · books · scholar · JSTOR ( December 2014 ) ( Learn how and when to remove this template message ) National Hockey League labor relations 1992 strike 1994–95 lockout 2004–05 lockout 2012–13 lockout Collective Bargaining Agreement Ice hockey portal v t e The 1994–95 NHL lockout was a lockout that came after a year of National Hockey League (NHL) hockey that was played without a collective bargaining agreement .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
16,132_2,What was the 1994–95 NHL lockout?,The 1994–95 NHL lockout was a six-month lockout during the 1994–95 NHL season.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
20,132_2,What was the 1994–95 NHL lockout?,The 1994–95 NHL lockout was a six-month lockout during the 1994–95 NHL season.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,132_2,What was the 1994–95 NHL lockout?,the 1994–95 nhl lockout was a year of national hockey league (nhl,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
16,132_2,What was the 1994–95 NHL lockout?,the 1994–95 nhl lockout was a year of national hockey league (nhl,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,This isn't a complete answer.,true,false,,
19,132_2,What was the 1994–95 NHL lockout?,The 1994–95 NHL lockout was a six-month period of time during which the National Hockey League (NHL) did not play games.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,132_2,What was the 1994–95 NHL lockout?,The 1994–95 NHL lockout was a six-month period of time during which the National Hockey League (NHL) did not play games.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,132_2,What was the 1994–95 NHL lockout?,The lockout occurred during the 1994–95 NHL season.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
15,132_2,What was the 1994–95 NHL lockout?,The lockout occurred during the 1994–95 NHL season.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,It doesn't state what it is.,false,true,,
12,133_1,"What was Rebel, Sweetheart by the Wallflowers?",the wallflowers returned to the studio to record their fifth album,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,133_1,"What was Rebel, Sweetheart by the Wallflowers?",the wallflowers returned to the studio to record their fifth album,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
20,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is the fourth studio album by The Wallflowers.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is the fourth studio album by The Wallflowers.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
64,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is the second studio album by the Wallflowers.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,"The response answers the question - though it is an incorrect answer. So, I've selected ""Yes"".",false,false,,
3,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is the second studio album by the Wallflowers.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
15,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is the fifth studio album by the American rock band the Wallflowers.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is the fifth studio album by the American rock band the Wallflowers.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
32,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is The Wallflowers' fifth album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,133_1,"What was Rebel, Sweetheart by the Wallflowers?","Rebel, Sweetheart is The Wallflowers' fifth album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,133_4,"Did any singles from The Wallflowers' album Rebel, Sweetheart chart?",The single The Beautiful Side of Somewhere hit #5 on AAA radio stations.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
44,133_4,"Did any singles from The Wallflowers' album Rebel, Sweetheart chart?",The single The Beautiful Side of Somewhere hit #5 on AAA radio stations.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,133_4,"Did any singles from The Wallflowers' album Rebel, Sweetheart chart?","The first single from the album, The Beautiful Side of Somewhere, hit No. 5 on AAA radio.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,133_4,"Did any singles from The Wallflowers' album Rebel, Sweetheart chart?","The first single from the album, The Beautiful Side of Somewhere, hit No. 5 on AAA radio.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
30,133_4,"Did any singles from The Wallflowers' album Rebel, Sweetheart chart?","The Wallflowers' album Rebel, Sweetheart's lead single, I'm Gonna Love You peaked at number one on the Billboard Hot 100.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
24,133_4,"Did any singles from The Wallflowers' album Rebel, Sweetheart chart?","The Wallflowers' album Rebel, Sweetheart's lead single, I'm Gonna Love You peaked at number one on the Billboard Hot 100.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,137_4,Did Nicole Kidman and Keith Urban have any children together?,"Nicole Kidman shares Sunday, 10 and Faith, eight, with her husband Keith Urban.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,137_4,Did Nicole Kidman and Keith Urban have any children together?,"Nicole Kidman shares Sunday, 10 and Faith, eight, with her husband Keith Urban.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,137_4,Did Nicole Kidman and Keith Urban have any children together?,Nicole Kidman and Keith Urban have two daughters.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
15,137_4,Did Nicole Kidman and Keith Urban have any children together?,Nicole Kidman and Keith Urban have two daughters.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
26,137_4,Did Nicole Kidman and Keith Urban have any children together?,"In fact, Nicole Kidman and Keith Urban both have a daughter-in-law named after their two sons. They both have two children and",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
9,137_4,Did Nicole Kidman and Keith Urban have any children together?,"In fact, Nicole Kidman and Keith Urban both have a daughter-in-law named after their two sons. They both have two children and",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
22,137_4,Did Nicole Kidman and Keith Urban have any children together?,"Keith Urban and his wife, Nicole Kidman, have two children.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,137_4,Did Nicole Kidman and Keith Urban have any children together?,"Keith Urban and his wife, Nicole Kidman, have two children.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
17,137_5,Did Nicole Kidman and Keith Urban have any other children?,"Nicole Kidman and Keith Urban have two children together, Sunday Rose and Faith Margaret.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,137_5,Did Nicole Kidman and Keith Urban have any other children?,"Nicole Kidman and Keith Urban have two children together, Sunday Rose and Faith Margaret.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,137_5,Did Nicole Kidman and Keith Urban have any other children?,Nicole Kidman and Keith Urban have three children together.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,137_5,Did Nicole Kidman and Keith Urban have any other children?,Nicole Kidman and Keith Urban have three children together.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,137_5,Did Nicole Kidman and Keith Urban have any other children?,"Nicole Kidman and Keith Urban have two children, Sunday, 10, and Faith, 8.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
4,137_5,Did Nicole Kidman and Keith Urban have any other children?,"Nicole Kidman and Keith Urban have two children, Sunday, 10, and Faith, 8.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
19,138_3,Where is Anton Webern from?,"Anton Webern was born in Stralsund, Austria-Hungary.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,138_3,Where is Anton Webern from?,"Anton Webern was born in Stralsund, Austria-Hungary.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,138_3,Where is Anton Webern from?,"Anton Webern was born in Vienna, Austria-Hungary.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,138_3,Where is Anton Webern from?,"Anton Webern was born in Vienna, Austria-Hungary.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,138_3,Where is Anton Webern from?," Anton Webern was born in Vienna, Austria.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,138_3,Where is Anton Webern from?," Anton Webern was born in Vienna, Austria.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
49,138_3,Where is Anton Webern from?,"Anton Webern was born in Berlin, Germany.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,"The response answers the question - though it is an incorrect answer. So, I've selected ""Yes'"".",false,false,,
5,138_3,Where is Anton Webern from?,"Anton Webern was born in Berlin, Germany.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
45,138_3,Where is Anton Webern from?,Anton Webern was born in Berlin.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
20,138_3,Where is Anton Webern from?,Anton Webern was born in Berlin.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,138_4,Was Anton Webern a composer?,Anton Webern was a German composer.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,138_4,Was Anton Webern a composer?,Anton Webern was a German composer.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
70,138_4,Was Anton Webern a composer?,Anton Webern was a composer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
17,138_4,Was Anton Webern a composer?,Anton Webern was a composer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,138_4,Was Anton Webern a composer?,Anton Webern was an Austrian composer and conductor.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
34,138_4,Was Anton Webern a composer?,Anton Webern was an Austrian composer and conductor.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,keystone bridge company was founded by andrew carnegie in 1874 as a,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
13,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,keystone bridge company was founded by andrew carnegie in 1874 as a,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,NICE,false,false,,
37,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,"Andrew Carnegie's company, Keystone Bridge Company, was founded in 1894.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
21,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,"Andrew Carnegie's company, Keystone Bridge Company, was founded in 1894.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
21,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,Andrew Carnegie founded the Keystone Bridge Company in 1865. It was one of the 28 companies absorbed into the American Bridge Company in 1900.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
18,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,Andrew Carnegie founded the Keystone Bridge Company in 1865. It was one of the 28 companies absorbed into the American Bridge Company in 1900.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
39,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,Andrew Carnegie's Keystone Bridge Company was founded in 1883.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
3,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,Andrew Carnegie's Keystone Bridge Company was founded in 1883.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
23,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,Keystone Bridge Company was founded in 1865 by Andrew Carnegie.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,139_1,How did Andrew Carnegie's Keystone Bridge Company come about?,Keystone Bridge Company was founded in 1865 by Andrew Carnegie.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,GOOD,false,false,,
87,14_5,"Describe core, aggregator and edge switches.","In a data center architecture, edge switches can be connected redundantly directly to core switch/router devices. However, for larger networks",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,OK,false,false,,
8,14_5,"Describe core, aggregator and edge switches.","In a data center architecture, edge switches can be connected redundantly directly to core switch/router devices. However, for larger networks",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
90,14_5,"Describe core, aggregator and edge switches.","The Distribution and Aggregation Layer In small networks of a few hundred users, edge switches can be connected redundantly directly to core switch/router devices.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
57,14_5,"Describe core, aggregator and edge switches.","The Distribution and Aggregation Layer In small networks of a few hundred users, edge switches can be connected redundantly directly to core switch/router devices.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
66,14_5,"Describe core, aggregator and edge switches.","Core switches are used to distribute network traffic, aggregation switches are used to distribute network traffic, and edge switches are used to distribute network traffic.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
38,14_5,"Describe core, aggregator and edge switches.","Core switches are used to distribute network traffic, aggregation switches are used to distribute network traffic, and edge switches are used to distribute network traffic.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,good,false,false,,
16,141_2,What sport did Kirby Puckett play?,Kirby Puckett was an outfielder for the Minnesota Twins baseball team.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,141_2,What sport did Kirby Puckett play?,Kirby Puckett was an outfielder for the Minnesota Twins baseball team.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,141_2,What sport did Kirby Puckett play?,Kirby Puckett played baseball.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,141_2,What sport did Kirby Puckett play?,Kirby Puckett played baseball.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
113,141_2,What sport did Kirby Puckett play?,Kirby Puckett was a right-handed pitcher.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
8,141_2,What sport did Kirby Puckett play?,Kirby Puckett was a right-handed pitcher.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
29,147_1,When did Hattie McDaniel die?,"hattie mcdaniel died at age 59 on october 26, 1952.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
11,147_1,When did Hattie McDaniel die?,"hattie mcdaniel died at age 59 on october 26, 1952.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
5,147_1,When did Hattie McDaniel die?,"Hattie McDaniel died on January 12, 1952.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,147_1,When did Hattie McDaniel die?,"Hattie McDaniel died on January 12, 1952.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,NICE,false,false,,
6,147_1,When did Hattie McDaniel die?,"Hattie McDaniel died on November 26, 1955.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,147_1,When did Hattie McDaniel die?,"Hattie McDaniel died on November 26, 1955.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
15,147_2,Where was Hattie McDaniel when she died,"hattie mcdaniel died of breast cancer at age 59 on october 26,",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
18,147_2,Where was Hattie McDaniel when she died,"hattie mcdaniel died of breast cancer at age 59 on october 26,",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
34,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died October 26, 1952",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
34,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died October 26, 1952",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died on October 26, 1952 in Woodland Hills, California.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
40,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died on October 26, 1952 in Woodland Hills, California.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
83,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died in the Motion Picture House in Woodland Hills, California.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,"October 26, 1952 (aged 59) Woodland Hills, Los Angeles, California, U.S.",false,false,,
26,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died in the Motion Picture House in Woodland Hills, California.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,GOOD,false,false,,
16,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died at the age of 81 at her home in Woodland Hills, California.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,147_2,Where was Hattie McDaniel when she died,"Hattie McDaniel died at the age of 81 at her home in Woodland Hills, California.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,147_3,Did Hattie McDaniel have any surviving family?,"Hattie McDaniel was survived by her second husband, William McDaniel, and three children.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,147_3,Did Hattie McDaniel have any surviving family?,"Hattie McDaniel was survived by her second husband, William McDaniel, and three children.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,GOOD,false,false,,
34,147_3,Did Hattie McDaniel have any surviving family?,Hattie McDaniel was survived by her husband and three children.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,147_3,Did Hattie McDaniel have any surviving family?,Hattie McDaniel was survived by her husband and three children.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,147_3,Did Hattie McDaniel have any surviving family?,"Hattie McDaniel was survived by her husband, Clyde McDaniel, and their three children.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,147_3,Did Hattie McDaniel have any surviving family?,"Hattie McDaniel was survived by her husband, Clyde McDaniel, and their three children.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,149_1,Was Patsy Mink ever married?,"While attending the University of Chicago Law School, Patsy Mink met hydrologist John Mink while playing bridge at the International House. He would become her husband and lifelong partner.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
44,149_1,Was Patsy Mink ever married?,"While attending the University of Chicago Law School, Patsy Mink met hydrologist John Mink while playing bridge at the International House. He would become her husband and lifelong partner.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
73,149_1,Was Patsy Mink ever married?,patsy met hydrologist john mink while playing bridge at the international house.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,INCOMPLETE,false,true,,
14,149_1,Was Patsy Mink ever married?,patsy met hydrologist john mink while playing bridge at the international house.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
11,149_1,Was Patsy Mink ever married?,Patsy Mink married hydrologist John Mink while playing bridge at the International House. He would become her husband and lifelong partner.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
24,149_1,Was Patsy Mink ever married?,Patsy Mink married hydrologist John Mink while playing bridge at the International House. He would become her husband and lifelong partner.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,149_4,Where was Patsy Mink's first job after law school?,Patsy Mink returned to her student job at the University of Chicago Law School library while her husband found work immediately with the United States Steel Corporation.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,149_4,Where was Patsy Mink's first job after law school?,Patsy Mink returned to her student job at the University of Chicago Law School library while her husband found work immediately with the United States Steel Corporation.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
56,149_4,Where was Patsy Mink's first job after law school?,"Unable to find work as a married, female, Asian-American attorney, Patsy Mink returned to her student job at the University of Chicago Law School library while her husband found work immediately with the United States Steel Corporation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
22,149_4,Where was Patsy Mink's first job after law school?,"Unable to find work as a married, female, Asian-American attorney, Patsy Mink returned to her student job at the University of Chicago Law School library while her husband found work immediately with the United States Steel Corporation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
18,149_4,Where was Patsy Mink's first job after law school?,"Unable to find work as a married, female, Asian-American attorney, she returned to her student job at the University of Chicago Law School library.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
21,149_4,Where was Patsy Mink's first job after law school?,"Unable to find work as a married, female, Asian-American attorney, she returned to her student job at the University of Chicago Law School library.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
20,149_6,Did John Burns get elected with the help of Patsy Mink?,"Yes, Patsy Mink helped Burn get elected",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,149_6,Did John Burns get elected with the help of Patsy Mink?,"Yes, Patsy Mink helped Burn get elected",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,149_6,Did John Burns get elected with the help of Patsy Mink?,John A. Burns was elected to Congress with the help of Patsy Mink.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,149_6,Did John Burns get elected with the help of Patsy Mink?,John A. Burns was elected to Congress with the help of Patsy Mink.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,149_6,Did John Burns get elected with the help of Patsy Mink?,Patsy Mink helped John Burns get elected.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,149_6,Did John Burns get elected with the help of Patsy Mink?,Patsy Mink helped John Burns get elected.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
97,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is one of 12 International Science Olympiads for secondary school students that has been held annually since,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
16,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is one of 12 International Science Olympiads for secondary school students that has been held annually since,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
6,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is an inter-university competition for students in the field of linguistics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
34,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is an inter-university competition for students in the field of linguistics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is an international linguistics competition.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is an international linguistics competition.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
34,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is an inter-university competition for students interested in linguistics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,confusing answer,
4,15_1,Tell me about the International Linguistics Olympiad.,The International Linguistics Olympiad (IOL) is an inter-university competition for students interested in linguistics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,confusing answer,
10,15_6,Who was Panini and what were his contributions?,"Panini was a Sanskrit grammarian who gave a comprehensive and scientific theory of phonetics, phonology, and",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,malformed answer,
9,15_6,Who was Panini and what were his contributions?,"Panini was a Sanskrit grammarian who gave a comprehensive and scientific theory of phonetics, phonology, and",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,VERY NICE,false,true,malformed answer,
9,15_6,Who was Panini and what were his contributions?,Panini is best known for his contributions to the study of Sanskrit grammar.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,VERY NICE,false,true,confusing answer,
38,15_6,Who was Panini and what were his contributions?,Panini is best known for his contributions to the study of Sanskrit grammar.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,confusing answer,
60,15_6,Who was Panini and what were his contributions?,Panini was a Sanskrit grammarian who lived in the 4th century BC. He is considered the father of Indian grammar.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,true,false,random answer,
35,15_6,Who was Panini and what were his contributions?,Panini was a Sanskrit grammarian who lived in the 4th century BC. He is considered the father of Indian grammar.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,15_7,What is the link between linguistics and computer science?,Linguistics is closely related to computer science.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
45,15_7,What is the link between linguistics and computer science?,Linguistics is closely related to computer science.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,15_7,What is the link between linguistics and computer science?,Linguistics is the study of language. Computer science is the study of computers.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,15_7,What is the link between linguistics and computer science?,Linguistics is the study of language. Computer science is the study of computers.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
73,15_7,What is the link between linguistics and computer science?,The link between linguistics and computer science is that linguistics and computer science are closely related.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,15_7,What is the link between linguistics and computer science?,The link between linguistics and computer science is that linguistics and computer science are closely related.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,good,false,false,,
22,151_1,When did Marco Rubio get elected into his current position in the Senate?,Marco Rubio was elected to the United States Senate in 2000.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,151_1,When did Marco Rubio get elected into his current position in the Senate?,Marco Rubio was elected to the United States Senate in 2000.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,151_1,When did Marco Rubio get elected into his current position in the Senate?,Marco Rubio was elected to the United States Senate in 2010.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
26,151_1,When did Marco Rubio get elected into his current position in the Senate?,Marco Rubio was elected to the United States Senate in 2010.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,151_1,When did Marco Rubio get elected into his current position in the Senate?,Marco Rubio was elected to the United States Senate in 2008,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,151_1,When did Marco Rubio get elected into his current position in the Senate?,Marco Rubio was elected to the United States Senate in 2008,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,151_1,When did Marco Rubio get elected into his current position in the Senate?,"In January 2011, Marco Rubio was elected to the United States Senate representing Florida.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,151_1,When did Marco Rubio get elected into his current position in the Senate?,"In January 2011, Marco Rubio was elected to the United States Senate representing Florida.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,NICE,false,false,,
14,153_2,Were the voicemails submitted by Richard Christy supposed to be voicemails he left for Howard Stern?,"After he obtained the number to reach the show's answering machine from the Internet, he began to submit comical voicemail messages in 1999,",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,,
64,153_2,Were the voicemails submitted by Richard Christy supposed to be voicemails he left for Howard Stern?,"After he obtained the number to reach the show's answering machine from the Internet, he began to submit comical voicemail messages in 1999,",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,GOOD,false,false,,
15,153_2,Were the voicemails submitted by Richard Christy supposed to be voicemails he left for Howard Stern?,he began to submit comical voicemail messages in 1999,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
5,153_2,Were the voicemails submitted by Richard Christy supposed to be voicemails he left for Howard Stern?,he began to submit comical voicemail messages in 1999,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
68,153_2,Were the voicemails submitted by Richard Christy supposed to be voicemails he left for Howard Stern?,"After he obtained the number to reach the show's answering machine from the Internet, he began to submit comical voicemail messages in 1999, that were played frequently on the air.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
9,153_2,Were the voicemails submitted by Richard Christy supposed to be voicemails he left for Howard Stern?,"After he obtained the number to reach the show's answering machine from the Internet, he began to submit comical voicemail messages in 1999, that were played frequently on the air.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
20,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene received his primary education at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene received his primary education at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
23,155_2,Where did J. R. Jayewardene go to school?,"Raised by an English nanny, J. R. Jayewardene received his primary education at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,155_2,Where did J. R. Jayewardene go to school?,"Raised by an English nanny, J. R. Jayewardene received his primary education at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,good,false,false,,
18,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene was educated at St. Joseph's College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
21,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene was educated at St. Joseph's College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
20,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene was educated at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
35,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene was educated at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
7,155_2,Where did J. R. Jayewardene go to school?,J. R. Jayewardene was educated at the Royal College of Music in Colombo.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,155_2,Where did J. R. Jayewardene go to school?,J. R. Jayewardene was educated at the Royal College of Music in Colombo.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene entered the University College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,155_2,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene entered the University College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,155_3,Was J. R. Jayewardene married?,"J. R. Jayewardene married Miss Elina Bandara Rupasinghe in 1935, Ravindra Vimal Jayewardene is their only child.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,155_3,Was J. R. Jayewardene married?,"J. R. Jayewardene married Miss Elina Bandara Rupasinghe in 1935, Ravindra Vimal Jayewardene is their only child.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,GOOD,false,false,,
21,155_3,Was J. R. Jayewardene married?,j. r. jayewardene married miss elina bandara rup,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
13,155_3,Was J. R. Jayewardene married?,j. r. jayewardene married miss elina bandara rup,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
34,155_3,Was J. R. Jayewardene married?,family life [ edit ] jayewardene married miss elina bandara rupasinghe in 1935,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
26,155_3,Was J. R. Jayewardene married?,family life [ edit ] jayewardene married miss elina bandara rupasinghe in 1935,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,It looks like a copy/paste rather than an answer.,true,false,,
18,155_3,Was J. R. Jayewardene married?,"J.R. Jayewardene married Miss Elina Bandara Rupasinghe in 1935, Ravindra Vimal Jayewardene is their only child,",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,155_3,Was J. R. Jayewardene married?,"J.R. Jayewardene married Miss Elina Bandara Rupasinghe in 1935, Ravindra Vimal Jayewardene is their only child,",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,156_7,"In Vrindavan, what did A. C. Bhaktivedanta Swami Prabhupada do?",A. C. Bhaktivedanta Swami Prabhupada built the Bhaktivedanta College in Vrindavan.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,156_7,"In Vrindavan, what did A. C. Bhaktivedanta Swami Prabhupada do?",A. C. Bhaktivedanta Swami Prabhupada built the Bhaktivedanta College in Vrindavan.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
35,156_7,"In Vrindavan, what did A. C. Bhaktivedanta Swami Prabhupada do?",A. C. Bhaktivedanta Swami Prabhupada lived in Vrindavan.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
7,156_7,"In Vrindavan, what did A. C. Bhaktivedanta Swami Prabhupada do?",A. C. Bhaktivedanta Swami Prabhupada lived in Vrindavan.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
19,156_7,"In Vrindavan, what did A. C. Bhaktivedanta Swami Prabhupada do?",A. C. Bhaktivedanta Swami Prabhupada was the founder of the ashram in Vrindavan.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
20,156_7,"In Vrindavan, what did A. C. Bhaktivedanta Swami Prabhupada do?",A. C. Bhaktivedanta Swami Prabhupada was the founder of the ashram in Vrindavan.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,158_5,Did Gene Tenace hit any homeruns in the 1972 World Series?,Gene Tenace hit a home run in Game 2 of the 2016 World Series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
14,158_5,Did Gene Tenace hit any homeruns in the 1972 World Series?,Gene Tenace hit a home run in Game 2 of the 2016 World Series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
8,158_5,Did Gene Tenace hit any homeruns in the 1972 World Series?,Gene Tenace hit three homeruns in one game.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
10,158_5,Did Gene Tenace hit any homeruns in the 1972 World Series?,Gene Tenace hit three homeruns in one game.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,,
19,158_5,Did Gene Tenace hit any homeruns in the 1972 World Series?,Gene Tenace hit two homeruns in the World Series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
3,158_5,Did Gene Tenace hit any homeruns in the 1972 World Series?,Gene Tenace hit two homeruns in the World Series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
32,16_1,What is a normal blood sugar level?,"Normal blood sugar is the amount of glucose that is in your blood, and understanding what normal blood sugar levels after eating are can help you monitor this factor and prevent any medical complications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,16_1,What is a normal blood sugar level?,"Normal blood sugar is the amount of glucose that is in your blood, and understanding what normal blood sugar levels after eating are can help you monitor this factor and prevent any medical complications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
15,16_1,What is a normal blood sugar level?,"A normal blood sugar level is the amount of glucose that is in your blood, and understanding what normal blood sugar levels after eating are can help you monitor this factor and prevent any medical complications.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,NA,false,false,,
41,16_1,What is a normal blood sugar level?,"A normal blood sugar level is the amount of glucose that is in your blood, and understanding what normal blood sugar levels after eating are can help you monitor this factor and prevent any medical complications.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
33,16_1,What is a normal blood sugar level?,Normal blood sugar levels are between 70 and 100 milligrams per deciliter.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,confusing answer,
7,16_1,What is a normal blood sugar level?,Normal blood sugar levels are between 70 and 100 milligrams per deciliter.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,confusing answer,
26,16_1,What is a normal blood sugar level?,normal blood sugar levels after eating normal blood sugar levels after eating blood sugar is the amount of glucose that is in your blood,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,correct answer,
37,16_1,What is a normal blood sugar level?,normal blood sugar levels after eating normal blood sugar levels after eating blood sugar is the amount of glucose that is in your blood,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,malformed answer,
97,16_3,What is a dangerous level for blood sugar?,A blood sugar level below 70 mg/dL is low and can harm you.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
48,16_3,What is a dangerous level for blood sugar?,A blood sugar level below 70 mg/dL is low and can harm you.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
76,16_3,What is a dangerous level for blood sugar?,A blood sugar level below 70 mg/dL (3.9 mmol/L) is low and can harm you. A blood sugar level below 54,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,correct answer,
28,16_3,What is a dangerous level for blood sugar?,A blood sugar level below 70 mg/dL (3.9 mmol/L) is low and can harm you. A blood sugar level below 54,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
101,16_3,What is a dangerous level for blood sugar?,a dangerous level for blood sugar is around 300 mg/dL.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
16,16_3,What is a dangerous level for blood sugar?,a dangerous level for blood sugar is around 300 mg/dL.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
12,16_3,What is a dangerous level for blood sugar?,A dangerous level of normal blood sugar is less than 200 mg/dl.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
52,16_3,What is a dangerous level for blood sugar?,A dangerous level of normal blood sugar is less than 200 mg/dl.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
44,16_5,How fast can blood sugar levels rise?,Blood sugar levels can rise as quickly as three hours after a meal.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
71,16_5,How fast can blood sugar levels rise?,Blood sugar levels can rise as quickly as three hours after a meal.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,16_5,How fast can blood sugar levels rise?,Blood sugar can rise quickly. It can take as little as a few seconds to reach your optimal blood glucose level.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,very nice,false,false,,
16,16_5,How fast can blood sugar levels rise?,Blood sugar can rise quickly. It can take as little as a few seconds to reach your optimal blood glucose level.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
21,16_5,How fast can blood sugar levels rise?,Normal blood glucose levels can rise in the human body as fast as eight hours after eating.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,confusing answer,
7,16_5,How fast can blood sugar levels rise?,Normal blood glucose levels can rise in the human body as fast as eight hours after eating.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,confusing answer,
10,161_2,What part did Victor McLaglen play in Happy Days?,Victor Maclaglen played the lead role in the sitcom Happy Days.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,161_2,What part did Victor McLaglen play in Happy Days?,Victor Maclaglen played the lead role in the sitcom Happy Days.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
19,161_2,What part did Victor McLaglen play in Happy Days?,Victor McLaglen was one of many Fox stars who had low-budget cameos in the musical Happy Days.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
85,161_2,What part did Victor McLaglen play in Happy Days?,Victor McLaglen was one of many Fox stars who had low-budget cameos in the musical Happy Days.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
5,161_2,What part did Victor McLaglen play in Happy Days?,Victor McLaglen was one of many Fox stars who had cameos in the musical Happy Days.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,161_2,What part did Victor McLaglen play in Happy Days?,Victor McLaglen was one of many Fox stars who had cameos in the musical Happy Days.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
27,161_2,What part did Victor McLaglen play in Happy Days?,Victor McLaglen played the lead role in Happy Days.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,161_2,What part did Victor McLaglen play in Happy Days?,Victor McLaglen played the lead role in Happy Days.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
47,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first female Secretary of Agriculture in the United States.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
20,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first female Secretary of Agriculture in the United States.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,GOOD,false,false,,
22,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first woman to hold the position of Secretary of the California Department of Food and Agriculture.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first woman to hold the position of Secretary of the California Department of Food and Agriculture.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first woman to hold the position of Secretary of Agriculture.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
34,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first woman to hold the position of Secretary of Agriculture.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first woman to hold the position of Secretary of the United States Department of Agriculture.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
21,162_3,What was Ann Veneman's distinctions?,Ann Veneman was the first woman to hold the position of Secretary of the United States Department of Agriculture.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
35,163_1,What was Gustave Courbet's The Artist's Studio?,Gustave Courbet's The Artist's Studio is a real allegory summing up seven years of my artistic and moral life.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,true,false,,
12,163_1,What was Gustave Courbet's The Artist's Studio?,Gustave Courbet's The Artist's Studio is a real allegory summing up seven years of my artistic and moral life.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
44,163_1,What was Gustave Courbet's The Artist's Studio?,"Artist Gustave Courbet Year 1855 Medium Oil on canvas Dimensions 361 cm × 598 cm (142 in × 235 in) Location Musée d'Orsay , Paris The Painter's Studio: A real allegory summing up seven years of my artistic and moral life ( L'Atelier du peintre ) is an 1855 oil on canvas painting by Gustave Courbet .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
13,163_1,What was Gustave Courbet's The Artist's Studio?,"Artist Gustave Courbet Year 1855 Medium Oil on canvas Dimensions 361 cm × 598 cm (142 in × 235 in) Location Musée d'Orsay , Paris The Painter's Studio: A real allegory summing up seven years of my artistic and moral life ( L'Atelier du peintre ) is an 1855 oil on canvas painting by Gustave Courbet .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
99,163_1,What was Gustave Courbet's The Artist's Studio?,The Painter's Studio is an 1855 oil on canvas painting by Gustave Courbet.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,The question should maybe mention The Painter's Studio instead of The Artist's Studio.,false,false,,
38,163_1,What was Gustave Courbet's The Artist's Studio?,The Painter's Studio is an 1855 oil on canvas painting by Gustave Courbet.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
106,164_3,Did W. H. Auden have siblings?,W. H. Auden was the second of four children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,INCOMPLETE,false,false,,
12,164_3,Did W. H. Auden have siblings?,W. H. Auden was the second of four children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,GOOD,false,false,,
11,164_3,Did W. H. Auden have siblings?,W. H. Auden was the third of six children.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,164_3,Did W. H. Auden have siblings?,W. H. Auden was the third of six children.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,164_3,Did W. H. Auden have siblings?,w. h. auden was the second of five sons who survived into adulthood;,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
12,164_3,Did W. H. Auden have siblings?,w. h. auden was the second of five sons who survived into adulthood;,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,GOOD,false,false,,
16,164_3,Did W. H. Auden have siblings?,W. H. Auden was the last of the family's seven children.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,164_3,Did W. H. Auden have siblings?,W. H. Auden was the last of the family's seven children.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,good,false,false,,
20,165_1,When did Scream Queens air?," Scream Queens aired on Fox on September 22, 2015.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,165_1,When did Scream Queens air?," Scream Queens aired on Fox on September 22, 2015.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,165_1,When did Scream Queens air?,"Scream Queens premiered on October 19, 2015 on Fox.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,165_1,When did Scream Queens air?,"Scream Queens premiered on October 19, 2015 on Fox.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,165_1,When did Scream Queens air?,"Scream Queens premiered on Fox on October 20, 2015.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
18,165_1,When did Scream Queens air?,"Scream Queens premiered on Fox on October 20, 2015.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,GOOD,false,false,,
13,165_1,When did Scream Queens air?,"Scream Queens premiered on October 23, 2015",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,165_1,When did Scream Queens air?,"Scream Queens premiered on October 23, 2015",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,165_1,When did Scream Queens air?,"Scream Queens airs on September 29, 2017, on ABC.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
28,165_1,When did Scream Queens air?,"Scream Queens airs on September 29, 2017, on ABC.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,Good answer but should use past-tense.,false,false,,
14,165_3,What is the TV show Scream Queens?,"Scream Queens is an American reality television series that premiered on the cable network VH1 on September 25, 2006.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,165_3,What is the TV show Scream Queens?,"Scream Queens is an American reality television series that premiered on the cable network VH1 on September 25, 2006.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,GOOD,false,false,,
15,165_3,What is the TV show Scream Queens?,Scream Queens is a 2017 American horror television series.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,165_3,What is the TV show Scream Queens?,Scream Queens is a 2017 American horror television series.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,GOOD,false,false,,
32,165_3,What is the TV show Scream Queens?,"Scream Queens is a horror anthology television series produced by Ryan Murphy and starring Lea Michele, Billie Lourd, and Emma Roberts.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,165_3,What is the TV show Scream Queens?,"Scream Queens is a horror anthology television series produced by Ryan Murphy and starring Lea Michele, Billie Lourd, and Emma Roberts.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,NICE,false,false,,
11,165_3,What is the TV show Scream Queens?,Scream Queens is an American horror comedy television series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
3,165_3,What is the TV show Scream Queens?,Scream Queens is an American horror comedy television series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
31,165_3,What is the TV show Scream Queens?,Scream Queens is a true crime anthology produced by Ryan Murphy for Fox.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
16,165_3,What is the TV show Scream Queens?,Scream Queens is a true crime anthology produced by Ryan Murphy for Fox.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,GOOD,false,false,,
13,165_3,What is the TV show Scream Queens?,Scream Queens is an American reality television series.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,165_3,What is the TV show Scream Queens?,Scream Queens is an American reality television series.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,165_3,What is the TV show Scream Queens?,Scream Queens is a 2016 American horror comedy television series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,165_3,What is the TV show Scream Queens?,Scream Queens is a 2016 American horror comedy television series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
17,165_3,What is the TV show Scream Queens?,Scream Queens is a comedy-horror television series on the Fox network.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
13,165_3,What is the TV show Scream Queens?,Scream Queens is a comedy-horror television series on the Fox network.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
9,165_3,What is the TV show Scream Queens?,Scream Queens is a 2016 American horror anthology television series created by Ryan Murphy.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,165_3,What is the TV show Scream Queens?,Scream Queens is a 2016 American horror anthology television series created by Ryan Murphy.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,good,false,false,,
68,165_3,What is the TV show Scream Queens?,Scream Queens is the second season of the horror anthology series Scream Queens. The two-hour series premiere of Scream Queens is Thursday September 22nd on FOX!,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
3,165_3,What is the TV show Scream Queens?,Scream Queens is the second season of the horror anthology series Scream Queens. The two-hour series premiere of Scream Queens is Thursday September 22nd on FOX!,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
35,165_3,What is the TV show Scream Queens?,Scream Queens is a television series on Fox.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,165_3,What is the TV show Scream Queens?,Scream Queens is a television series on Fox.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,NICE,false,false,,
14,166_3,"What other business ventures does Justin Timberlake own besides the restaurants Chi, Destino, and Hospitality?","timberlake launched the william rast clothing line with childhood friend juan ( "" trace "" ) ayala",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
65,166_3,"What other business ventures does Justin Timberlake own besides the restaurants Chi, Destino, and Hospitality?","timberlake launched the william rast clothing line with childhood friend juan ( "" trace "" ) ayala",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,good,false,true,,
16,166_3,"What other business ventures does Justin Timberlake own besides the restaurants Chi, Destino, and Hospitality?","In 2005, Timberlake launched the William Rast clothing line with childhood friend Juan Ayala.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,166_3,"What other business ventures does Justin Timberlake own besides the restaurants Chi, Destino, and Hospitality?","In 2005, Timberlake launched the William Rast clothing line with childhood friend Juan Ayala.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
67,166_3,"What other business ventures does Justin Timberlake own besides the restaurants Chi, Destino, and Hospitality?","In 2005, Justin Timberlake launched the William Rast clothing line with childhood friend Juan (""Trace"") Ayala.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
31,166_3,"What other business ventures does Justin Timberlake own besides the restaurants Chi, Destino, and Hospitality?","In 2005, Justin Timberlake launched the William Rast clothing line with childhood friend Juan (""Trace"") Ayala.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,169_1,What happened with Sam Thompson and the 1896-98 seasons?,"At age 36, Thompson played his last full season of professional baseball in 1896. His average dipped to.298, but he still managed to collect 100 RBIs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,169_1,What happened with Sam Thompson and the 1896-98 seasons?,"At age 36, Thompson played his last full season of professional baseball in 1896. His average dipped to.298, but he still managed to collect 100 RBIs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
28,169_1,What happened with Sam Thompson and the 1896-98 seasons?,Sam Thompson played his last full season of professional baseball in 1896.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,169_1,What happened with Sam Thompson and the 1896-98 seasons?,Sam Thompson played his last full season of professional baseball in 1896.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,169_1,What happened with Sam Thompson and the 1896-98 seasons?,"At age 36, Ted Thompson played his last full season of professional baseball in 1896. His average dipped to.298, but he still managed to collect 100 RBIs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
19,169_1,What happened with Sam Thompson and the 1896-98 seasons?,"At age 36, Ted Thompson played his last full season of professional baseball in 1896. His average dipped to.298, but he still managed to collect 100 RBIs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
54,17_1,What are the different forms of energy?,"Various forms of energy such as light, heat, sound, electrical, nuclear, chemical, etc are briefly explained.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
14,17_1,What are the different forms of energy?,"Various forms of energy such as light, heat, sound, electrical, nuclear, chemical, etc are briefly explained.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,NA,false,false,confusing answer,
11,17_1,What are the different forms of energy?,There are different forms of energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
35,17_1,What are the different forms of energy?,There are different forms of energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,NICE,false,true,correct answer,
6,17_1,What are the different forms of energy?,"Examples of these are: light energy, heat energy, mechanical energy, electrical energy, sound energy, chemical energy, nuclear or",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
12,17_1,What are the different forms of energy?,"Examples of these are: light energy, heat energy, mechanical energy, electrical energy, sound energy, chemical energy, nuclear or",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
42,17_1,What are the different forms of energy?,"The different forms of energy are heat, electricity, and light.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
38,17_1,What are the different forms of energy?,"The different forms of energy are heat, electricity, and light.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
26,17_1,What are the different forms of energy?,"The different forms of energy include biomass energy, renewable energy, and kinetic energy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
32,17_1,What are the different forms of energy?,"The different forms of energy include biomass energy, renewable energy, and kinetic energy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,many energy levels,false,false,correct answer,
28,17_3,What type of energy is used in motion?,Motion energy is the energy stored in moving objects.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
41,17_3,What type of energy is used in motion?,Motion energy is the energy stored in moving objects.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
43,17_3,What type of energy is used in motion?,"Motion energy – also known as motion energy – is the energy stored in moving objects. As the object moves faster, more energy is stored.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
22,17_3,What type of energy is used in motion?,"Motion energy – also known as motion energy – is the energy stored in moving objects. As the object moves faster, more energy is stored.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
7,17_3,What type of energy is used in motion?,Motion energy is the sum of potential and kinetic energy in an object that is used to do work.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
71,17_3,What type of energy is used in motion?,Motion energy is the sum of potential and kinetic energy in an object that is used to do work.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,17_3,What type of energy is used in motion?,Motion energy – also known as mechanical energy – is the energy stored in moving objects.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,17_3,What type of energy is used in motion?,Motion energy – also known as mechanical energy – is the energy stored in moving objects.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,17_3,What type of energy is used in motion?,It is kinetic energy.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,17_3,What type of energy is used in motion?,It is kinetic energy.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,17_3,What type of energy is used in motion?,motion energy is the sum of potential and kinetic energy in an object that is used to,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
23,17_3,What type of energy is used in motion?,motion energy is the sum of potential and kinetic energy in an object that is used to,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,correct,false,false,malformed answer,
17,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy that exists in a given situation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
23,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy that exists in a given situation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,17_4,Tell me about mechanical energy.,Mechanical energy is the energy that is used to move objects.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
19,17_4,Tell me about mechanical energy.,Mechanical energy is the energy that is used to move objects.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,17_4,Tell me about mechanical energy.,Mechanical energy is the kinetic energy produced by mechanical action.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
27,17_4,Tell me about mechanical energy.,Mechanical energy is the kinetic energy produced by mechanical action.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,good,false,false,,
11,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy that exists in the physical world.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy that exists in the physical world.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
43,17_4,Tell me about mechanical energy.,Mechanical energy is often confused with Kinetic Energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,17_4,Tell me about mechanical energy.,Mechanical energy is often confused with Kinetic Energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy produced by a system.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy produced by a system.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy produced by the action of mechanical forces.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,17_4,Tell me about mechanical energy.,Mechanical energy is the amount of energy produced by the action of mechanical forces.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
30,17_4,Tell me about mechanical energy.,"Mechanical energy is the sum of kinetic and potential energy in an object that is used to do work. In other words, it is energy in an object",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
4,17_4,Tell me about mechanical energy.,"Mechanical energy is the sum of kinetic and potential energy in an object that is used to do work. In other words, it is energy in an object",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
34,17_4,Tell me about mechanical energy.,Mechanical energy is the sum of potential and kinetic energy in an object that is used to do work.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,17_4,Tell me about mechanical energy.,Mechanical energy is the sum of potential and kinetic energy in an object that is used to do work.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
90,17_6,Why is sound a form of mechanical energy?,Sound is a form of mechanical energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,random answer,
6,17_6,Why is sound a form of mechanical energy?,Sound is a form of mechanical energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
37,17_6,Why is sound a form of mechanical energy?,Sound is a form of mechanical energy because the source of sound is vibration.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
45,17_6,Why is sound a form of mechanical energy?,Sound is a form of mechanical energy because the source of sound is vibration.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
21,17_6,Why is sound a form of mechanical energy?,Sound is a form of mechanical energy because it is used to move objects.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,VERY NICE,false,false,,
35,17_6,Why is sound a form of mechanical energy?,Sound is a form of mechanical energy because it is used to move objects.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
59,17_6,Why is sound a form of mechanical energy?,2010 at 4 : 09 am sound is a form of mechanical energy because the source of sound is vibration,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,malformed answer,
10,17_6,Why is sound a form of mechanical energy?,2010 at 4 : 09 am sound is a form of mechanical energy because the source of sound is vibration,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,malformed answer,
71,17_7,How does mechanical energy differ from potential energy?,Mechanical energy is the energy that is possessed by an object due to its motion.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
85,17_7,How does mechanical energy differ from potential energy?,Mechanical energy is the energy that is possessed by an object due to its motion.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
52,17_7,How does mechanical energy differ from potential energy?,The sum of kinetic energy and potential energy is known as mechanical energy which can neither be created nor destroyed but can be converted from one form to other.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,confusing answer,
114,17_7,How does mechanical energy differ from potential energy?,The sum of kinetic energy and potential energy is known as mechanical energy which can neither be created nor destroyed but can be converted from one form to other.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
24,17_7,How does mechanical energy differ from potential energy?,Kinetic energy is defined as the energy present in an object from the state of rest to motion. Potential energy is defined as the energy contained in an object by the virtue object's position.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
62,17_7,How does mechanical energy differ from potential energy?,Kinetic energy is defined as the energy present in an object from the state of rest to motion. Potential energy is defined as the energy contained in an object by the virtue object's position.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,17_7,How does mechanical energy differ from potential energy?,Potential energy is the energy that is stored in an object.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,correct answer,
13,17_7,How does mechanical energy differ from potential energy?,Potential energy is the energy that is stored in an object.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,random answer,
70,17_7,How does mechanical energy differ from potential energy?,Mechanical energy consists of gravitational potential energy and kinetic energy. Vibrating particles have kinetic energy which is a form of mechanical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
105,17_7,How does mechanical energy differ from potential energy?,Mechanical energy consists of gravitational potential energy and kinetic energy. Vibrating particles have kinetic energy which is a form of mechanical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
38,17_7,How does mechanical energy differ from potential energy?,Mechanical energy is the total energy of a system.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
21,17_7,How does mechanical energy differ from potential energy?,Mechanical energy is the total energy of a system.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,good,false,false,random answer,
48,17_7,How does mechanical energy differ from potential energy?,"when in use mechanical energy is different from potential energy, it refers to the difference between",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
74,17_7,How does mechanical energy differ from potential energy?,"when in use mechanical energy is different from potential energy, it refers to the difference between",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
34,17_7,How does mechanical energy differ from potential energy?,Potential energy refers to the amount of energy that can be produced by a single action. Kinetic energy refers to the amount of energy that can be produced by a single action.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,true,false,random answer,
9,17_7,How does mechanical energy differ from potential energy?,Potential energy refers to the amount of energy that can be produced by a single action. Kinetic energy refers to the amount of energy that can be produced by a single action.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
34,17_8,Are potential energy and kinetic energy the same?,Kinetic energy is energy possessed by a body by virtue of its movement. Potential energy is the energy possessed by a body by virtue of its position or state.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
23,17_8,Are potential energy and kinetic energy the same?,Kinetic energy is energy possessed by a body by virtue of its movement. Potential energy is the energy possessed by a body by virtue of its position or state.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
60,17_8,Are potential energy and kinetic energy the same?,Potential energy is the energy possessed by a body by virtue of its movement. Kinetic energy is the energy possessed by an object by virtue of its acceleration.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
19,17_8,Are potential energy and kinetic energy the same?,Potential energy is the energy possessed by a body by virtue of its movement. Kinetic energy is the energy possessed by an object by virtue of its acceleration.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
38,17_8,Are potential energy and kinetic energy the same?,Potential energy is the stored energy in an object or system because of its position or configuration. Kinetic energy is the energy possessed by a body by virtue of its movement.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
36,17_8,Are potential energy and kinetic energy the same?,Potential energy is the stored energy in an object or system because of its position or configuration. Kinetic energy is the energy possessed by a body by virtue of its movement.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
29,17_8,Are potential energy and kinetic energy the same?,"While kinetic energy of an object is relative to the state of other objects in its environment, potential energy is completely independent of its environment.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
55,17_8,Are potential energy and kinetic energy the same?,"While kinetic energy of an object is relative to the state of other objects in its environment, potential energy is completely independent of its environment.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,17_8,Are potential energy and kinetic energy the same?,Potential energy is the energy possessed by a body by virtue of its position or state. Kinetic energy is the energy possessed by a body by virtue of its movement.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
52,17_8,Are potential energy and kinetic energy the same?,Potential energy is the energy possessed by a body by virtue of its position or state. Kinetic energy is the energy possessed by a body by virtue of its movement.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
57,17_8,Are potential energy and kinetic energy the same?,potential energy and kinetic energy are two different types of energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
98,17_8,Are potential energy and kinetic energy the same?,potential energy and kinetic energy are two different types of energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
30,17_9,What type does chemical energy belong to?,Chemical energy is a type of energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,true,false,correct answer,
5,17_9,What type does chemical energy belong to?,Chemical energy is a type of energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,random answer,
95,17_9,What type does chemical energy belong to?,Chemical energy is the energy possessed by a body by virtue of its movement.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,17_9,What type does chemical energy belong to?,Chemical energy is the energy possessed by a body by virtue of its movement.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,17_9,What type does chemical energy belong to?,Chemical energy is a type of semiconducting chemical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,17_9,What type does chemical energy belong to?,Chemical energy is a type of semiconducting chemical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,17_9,What type does chemical energy belong to?,Chemical energy is the energy that is used to break chemical bonds.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
36,17_9,What type does chemical energy belong to?,Chemical energy is the energy that is used to break chemical bonds.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
45,17_9,What type does chemical energy belong to?,Chemical energy is the energy used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,random answer,
10,17_9,What type does chemical energy belong to?,Chemical energy is the energy used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used in the production of the raw materials used,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,true,false,correct answer,
22,173_8,Did Mark Taylor (cricketer) graduate from the University of South Wales?,Mark Taylor later obtained a degree in surveying at the University of New South Wales.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,173_8,Did Mark Taylor (cricketer) graduate from the University of South Wales?,Mark Taylor later obtained a degree in surveying at the University of New South Wales.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,173_8,Did Mark Taylor (cricketer) graduate from the University of South Wales?,Mark Taylor graduated from the University of New South Wales with a degree in surveying in 1987.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,173_8,Did Mark Taylor (cricketer) graduate from the University of South Wales?,Mark Taylor graduated from the University of New South Wales with a degree in surveying in 1987.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,173_8,Did Mark Taylor (cricketer) graduate from the University of South Wales?,Mark Taylor received a degree in surveying from the University of New South Wales in 1987.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,173_8,Did Mark Taylor (cricketer) graduate from the University of South Wales?,Mark Taylor received a degree in surveying from the University of New South Wales in 1987.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
19,174_12,Did Lou Reed produce anything in 1984?,"In 1984, Lou Reed released his 13th solo studio album, New Sensations.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,174_12,Did Lou Reed produce anything in 1984?,"In 1984, Lou Reed released his 13th solo studio album, New Sensations.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
8,174_12,Did Lou Reed produce anything in 1984?,"1984 studio album by lou reed new sensations studio album by lou reed released april 1984 studio skyline studios,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
3,174_12,Did Lou Reed produce anything in 1984?,"1984 studio album by lou reed new sensations studio album by lou reed released april 1984 studio skyline studios,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,174_12,Did Lou Reed produce anything in 1984?,"Lou Reed released his thirteenth solo studio album, New Sensations, in April 1984 by RCA Records.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,174_12,Did Lou Reed produce anything in 1984?,"Lou Reed released his thirteenth solo studio album, New Sensations, in April 1984 by RCA Records.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,174_9,What was The Blue Mask by Lou Reed?,Blue Mask is a song by Lou Reed.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,174_9,What was The Blue Mask by Lou Reed?,Blue Mask is a song by Lou Reed.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,174_9,What was The Blue Mask by Lou Reed?,The Blue Mask is the eleventh solo studio album by Lou Reed.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,174_9,What was The Blue Mask by Lou Reed?,The Blue Mask is the eleventh solo studio album by Lou Reed.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,174_9,What was The Blue Mask by Lou Reed?,"The Blue Mask is the eleventh solo studio album by American musician Lou Reed. It was released around Reed's 40th birthday, and covers topics of marriage and settling down,",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,174_9,What was The Blue Mask by Lou Reed?,"The Blue Mask is the eleventh solo studio album by American musician Lou Reed. It was released around Reed's 40th birthday, and covers topics of marriage and settling down,",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,174_9,What was The Blue Mask by Lou Reed?,The Blue Mask is the second studio album by Lou Reed.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,174_9,What was The Blue Mask by Lou Reed?,The Blue Mask is the second studio album by Lou Reed.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,174_9,What was The Blue Mask by Lou Reed?,the blue mask is the fifth studio album by american rock singer lou reed.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
9,174_9,What was The Blue Mask by Lou Reed?,the blue mask is the fifth studio album by american rock singer lou reed.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
19,176_6,What made David Marks leave the Beach Boys?,"In August 1963, personal issues with manager Murry Wilson caused David Marks to leave the Beach Boys.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,176_6,What made David Marks leave the Beach Boys?,"In August 1963, personal issues with manager Murry Wilson caused David Marks to leave the Beach Boys.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,176_6,What made David Marks leave the Beach Boys?,"At the height of their first initial wave of international success, Mark Marks quit the Beach Boys in late August 1963 toward the end of the group's summer tour during an argument with Murry Wilson, the Wilson boys' father and the band's manager, but did not immediately leave the band until later that year when his parents and Murry came to blows over financial and managerial issues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
4,176_6,What made David Marks leave the Beach Boys?,"At the height of their first initial wave of international success, Mark Marks quit the Beach Boys in late August 1963 toward the end of the group's summer tour during an argument with Murry Wilson, the Wilson boys' father and the band's manager, but did not immediately leave the band until later that year when his parents and Murry came to blows over financial and managerial issues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
17,176_6,What made David Marks leave the Beach Boys?,"In August 1963, personal issues with manager Murry Wilson caused David Marks to leave the group.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,176_6,What made David Marks leave the Beach Boys?,"In August 1963, personal issues with manager Murry Wilson caused David Marks to leave the group.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,18_1,Describe Uranus.,Uranus (from the Latin name ranus for the Greek god ) is the seventh planet from the Sun. It has the third,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
24,18_1,Describe Uranus.,Uranus (from the Latin name ranus for the Greek god ) is the seventh planet from the Sun. It has the third,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
32,18_1,Describe Uranus.,Uranus is the ninth planet of the Zodiac.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
15,18_1,Describe Uranus.,Uranus is the ninth planet of the Zodiac.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
28,18_1,Describe Uranus.,Uranus is the eighth planet of the Solar System.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
18,18_1,Describe Uranus.,Uranus is the eighth planet of the Solar System.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,18_1,Describe Uranus.,Uranus is the sixth planet of the Solar System.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,confusing answer,
66,18_1,Describe Uranus.,Uranus is the sixth planet of the Solar System.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,confusing answer,
23,18_1,Describe Uranus.,"Uranus is a planet in the solar system. It is the seventh planet from the Sun. It is named after the Greek god of the sky, Uranus.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,18_1,Describe Uranus.,"Uranus is a planet in the solar system. It is the seventh planet from the Sun. It is named after the Greek god of the sky, Uranus.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,18_1,Describe Uranus.,Uranus is a planet in the constellation Aries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
99,18_1,Describe Uranus.,Uranus is a planet in the constellation Aries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,18_1,Describe Uranus.,Uranus is the fifth planet of the Zodiac.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,confusing answer,
4,18_1,Describe Uranus.,Uranus is the fifth planet of the Zodiac.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,confusing answer,
74,18_1,Describe Uranus.,Uranus is a planet in the Solar System.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
54,18_1,Describe Uranus.,Uranus is a planet in the Solar System.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
13,18_1,Describe Uranus.,Uranus is the fifth planet of the Solar System.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,18_1,Describe Uranus.,Uranus is the fifth planet of the Solar System.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
21,18_2,What makes Uranus so unusual?,Uranus is the only planet in Earth's orbit that is directly opposite the Sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,VERY NICE,false,false,,
29,18_2,What makes Uranus so unusual?,Uranus is the only planet in Earth's orbit that is directly opposite the Sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
79,18_2,What makes Uranus so unusual?,"Unlike the other planets of the solar system, Uranus tilts so far that it essentially orbits the sun on its side",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
23,18_2,What makes Uranus so unusual?,"Unlike the other planets of the solar system, Uranus tilts so far that it essentially orbits the sun on its side",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
5,18_2,What makes Uranus so unusual?,"In the late 19th and early 20th centuries, Uranus was the only planet in Earth's orbit that was not a planet in the Sun's orbit.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,18_2,What makes Uranus so unusual?,"In the late 19th and early 20th centuries, Uranus was the only planet in Earth's orbit that was not a planet in the Sun's orbit.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
46,18_3,Tell me about Uranus's orbit.,Uranus orbits the Sun.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
55,18_3,Tell me about Uranus's orbit.,Uranus orbits the Sun.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
25,18_3,Tell me about Uranus's orbit.,"Uranus orbits the Sun once every 365 years, taking an average of seven years to pass through each constellation of the zodiac. In",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
22,18_3,Tell me about Uranus's orbit.,"Uranus orbits the Sun once every 365 years, taking an average of seven years to pass through each constellation of the zodiac. In",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
7,18_3,Tell me about Uranus's orbit.,Uranus orbits the Sun once every 84 years.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,18_3,Tell me about Uranus's orbit.,Uranus orbits the Sun once every 84 years.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
19,18_4,Why is Uranus tilted?,Uranus is tilted.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
37,18_4,Why is Uranus tilted?,Uranus is tilted.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,true,false,correct answer,
17,18_4,Why is Uranus tilted?,Uranus orbits at an angle of 0.77 degrees from the Sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
22,18_4,Why is Uranus tilted?,Uranus orbits at an angle of 0.77 degrees from the Sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
36,18_4,Why is Uranus tilted?,"Uranus is the only planet whose equator is nearly at a right angle to its orbit, with a tilt of 58",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,surely yes,false,false,confusing answer,
6,18_4,Why is Uranus tilted?,"Uranus is the only planet whose equator is nearly at a right angle to its orbit, with a tilt of 58",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,confusing answer,
61,18_4,Why is Uranus tilted?,Uranus's orbit is tilted 23.5 degrees from the plane of its internal plane.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
35,18_4,Why is Uranus tilted?,Uranus's orbit is tilted 23.5 degrees from the plane of its internal plane.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
24,18_4,Why is Uranus tilted?,Uranus's orbit is tilted 23.5 degrees to its plane of origin.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
75,18_4,Why is Uranus tilted?,Uranus's orbit is tilted 23.5 degrees to its plane of origin.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
24,18_4,Why is Uranus tilted?,Uranus is tilted because it is on the side of the solar system that is farthest from the Sun.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,18_4,Why is Uranus tilted?,Uranus is tilted because it is on the side of the solar system that is farthest from the Sun.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,18_4,Why is Uranus tilted?,Uranus' orbit is tilted at an angle of 0.77 to Earth's orbital plane.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,correct answer,
25,18_4,Why is Uranus tilted?,Uranus' orbit is tilted at an angle of 0.77 to Earth's orbital plane.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,random answer,
9,18_4,Why is Uranus tilted?,"Uranus's orbit is tilted 23.5 degrees, with respect to the sun.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,correct answer,
48,18_4,Why is Uranus tilted?,"Uranus's orbit is tilted 23.5 degrees, with respect to the sun.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,correct answer,
111,18_4,Why is Uranus tilted?,Uranus is tilted 23.5 degrees from the plane of its orbit.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,correct answer,
12,18_4,Why is Uranus tilted?,Uranus is tilted 23.5 degrees from the plane of its orbit.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,correct answer,
15,18_5,How is its rotation of Uranus different from other planets?,"Unlike any other planet, Uranus rotates on its side.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,18_5,How is its rotation of Uranus different from other planets?,"Unlike any other planet, Uranus rotates on its side.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
38,18_5,How is its rotation of Uranus different from other planets?,"Uranus is tilted 82.23 and rotates, i.e., “backward” from Earth. For six of the planets, there is no difference between the two conventions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
22,18_5,How is its rotation of Uranus different from other planets?,"Uranus is tilted 82.23 and rotates, i.e., “backward” from Earth. For six of the planets, there is no difference between the two conventions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,NICE,false,false,,
7,18_5,How is its rotation of Uranus different from other planets?,Uranus rotates on its side.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,18_5,How is its rotation of Uranus different from other planets?,Uranus rotates on its side.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,18_5,How is its rotation of Uranus different from other planets?,The rotation of Uranus is different from the rotational axis of other planets because it rotates twice as fast.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
50,18_5,How is its rotation of Uranus different from other planets?,The rotation of Uranus is different from the rotational axis of other planets because it rotates twice as fast.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
94,18_6,What is peculiar about Uranus's seasons?,"Near the summer and winter solstices, Uranus' hemispheres lie alternately either in full glare of the Sun's rays or facing deep space.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,18_6,What is peculiar about Uranus's seasons?,"Near the summer and winter solstices, Uranus' hemispheres lie alternately either in full glare of the Sun's rays or facing deep space.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,18_6,What is peculiar about Uranus's seasons?,Uranus has seasons because it is tilted on its side.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,18_6,What is peculiar about Uranus's seasons?,Uranus has seasons because it is tilted on its side.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
25,18_6,What is peculiar about Uranus's seasons?,"Uranus's seasons are characterized by the Sun's shadow, which is visible from the planet's north pole.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,confusing answer,
27,18_6,What is peculiar about Uranus's seasons?,"Uranus's seasons are characterized by the Sun's shadow, which is visible from the planet's north pole.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,confusing answer,
20,182_1,What was Enrique Iglesias doing between 2002 and 2004?,In 2002 Iglesias chose to release a fourth Spanish-language album titled Quizs (Perhaps).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
24,182_1,What was Enrique Iglesias doing between 2002 and 2004?,In 2002 Iglesias chose to release a fourth Spanish-language album titled Quizs (Perhaps).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,GOOD,false,false,,
63,182_1,What was Enrique Iglesias doing between 2002 and 2004?,"In 2002, Enrique Iglesias released his third studio album, La Vida Loca.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,182_1,What was Enrique Iglesias doing between 2002 and 2004?,"In 2002, Enrique Iglesias released his third studio album, La Vida Loca.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
18,182_1,What was Enrique Iglesias doing between 2002 and 2004?,"In 2002, Enrique Iglesias released a fourth Spanish-language album titled Quizs (Perhaps).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
6,182_1,What was Enrique Iglesias doing between 2002 and 2004?,"In 2002, Enrique Iglesias released a fourth Spanish-language album titled Quizs (Perhaps).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
23,182_1,What was Enrique Iglesias doing between 2002 and 2004?,"In 2002, Enrique Iglesias released his third studio album, Iglesias.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,182_1,What was Enrique Iglesias doing between 2002 and 2004?,"In 2002, Enrique Iglesias released his third studio album, Iglesias.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,182_1,What was Enrique Iglesias doing between 2002 and 2004?,In 2002 Enrique Iglesias chose to release a fourth Spanish-language album titled Quizs (Perhaps).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
3,182_1,What was Enrique Iglesias doing between 2002 and 2004?,In 2002 Enrique Iglesias chose to release a fourth Spanish-language album titled Quizs (Perhaps).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,182_7,Did the album 7 by Enrique Iglesias gain critical success?,"The album Quizs by Enrique Iglesias received mixed reviews, with critics comparing it negatively with his 2001 album saying it didn't live up to the expectations that Escape had created.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
45,182_7,Did the album 7 by Enrique Iglesias gain critical success?,"The album Quizs by Enrique Iglesias received mixed reviews, with critics comparing it negatively with his 2001 album saying it didn't live up to the expectations that Escape had created.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,NICE,false,false,,
19,182_7,Did the album 7 by Enrique Iglesias gain critical success?,The album 7 by Enrique Iglesias received mixed reviews from music critics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
79,182_7,Did the album 7 by Enrique Iglesias gain critical success?,The album 7 by Enrique Iglesias received mixed reviews from music critics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
24,182_7,Did the album 7 by Enrique Iglesias gain critical success?,"The album 7 by Enrique Iglesias received mixed reviews, with critics comparing it negatively with his 2001 album saying it didn't live up to the expectations that Escape had created.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,182_7,Did the album 7 by Enrique Iglesias gain critical success?,"The album 7 by Enrique Iglesias received mixed reviews, with critics comparing it negatively with his 2001 album saying it didn't live up to the expectations that Escape had created.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
24,185_3,What material were the buildings in Gaelic Ireland made of?,"In some areas, buildings were made mostly of stone. In others, they were built of timber, and daub, or a mix of materials.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,185_3,What material were the buildings in Gaelic Ireland made of?,"In some areas, buildings were made mostly of stone. In others, they were built of timber, and daub, or a mix of materials.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,185_3,What material were the buildings in Gaelic Ireland made of?,buildings were made mostly of stone,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,185_3,What material were the buildings in Gaelic Ireland made of?,buildings were made mostly of stone,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
14,185_3,What material were the buildings in Gaelic Ireland made of?,The buildings were made of wood and stone.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,185_3,What material were the buildings in Gaelic Ireland made of?,The buildings were made of wood and stone.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
17,186_5,Did Larry Bird ever receive any awards because of his playing?,1981 1982 1984 1989 larry bird won three consecutive nba mvp awards,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
20,186_5,Did Larry Bird ever receive any awards because of his playing?,1981 1982 1984 1989 larry bird won three consecutive nba mvp awards,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
42,186_5,Did Larry Bird ever receive any awards because of his playing?,Larry Bird won three consecutive NBA MVP awards. His final award was in 1986.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
3,186_5,Did Larry Bird ever receive any awards because of his playing?,Larry Bird won three consecutive NBA MVP awards. His final award was in 1986.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,186_5,Did Larry Bird ever receive any awards because of his playing?,"At the 2019 NBA Awards, Larry Bird received the NBA Lifetime Achievement Award.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
7,186_5,Did Larry Bird ever receive any awards because of his playing?,"At the 2019 NBA Awards, Larry Bird received the NBA Lifetime Achievement Award.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,Larry Bird was inducted into the Naismith Memorial Basketball Hall of Fame in 1987.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,Larry Bird was inducted into the Naismith Memorial Basketball Hall of Fame in 1987.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,Larry Bird was elected to the Naismith Memorial Basketball Hall of Fame in 2018.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
20,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,Larry Bird was elected to the Naismith Memorial Basketball Hall of Fame in 2018.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
17,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,"Larry Bird was voted to the NBA Hall of Fame in 1996, and was inducted into the Naismith Memorial Basketball Hall of Fame in 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,"Larry Bird was voted to the NBA Hall of Fame in 1996, and was inducted into the Naismith Memorial Basketball Hall of Fame in 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
12,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,"Larry Bird was elected to the NBA's 50th Anniversary All-Time Team in 1996, was inducted into the Naismith Memorial Basketball Hall of Fame in 1998, and was inducted into the Hall of Fame again in 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,186_6,Did Larry Bird win any other awards besides being a 12-time NBA All-Star and the NBA Most Valuable Player Award?,"Larry Bird was elected to the NBA's 50th Anniversary All-Time Team in 1996, was inducted into the Naismith Memorial Basketball Hall of Fame in 1998, and was inducted into the Hall of Fame again in 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
22,189_1,When was J. R. Jayewardene born?,J. R. Jayewardene was born on 15 September 1914.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
9,189_1,When was J. R. Jayewardene born?,J. R. Jayewardene was born on 15 September 1914.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,189_1,When was J. R. Jayewardene born?,"J. R. R. Jayewardene was born in Colombo, Ceylon, on 5 November 1894.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,189_1,When was J. R. Jayewardene born?,"J. R. R. Jayewardene was born in Colombo, Ceylon, on 5 November 1894.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
29,189_1,When was J. R. Jayewardene born?,j. r. jayewardene was born on 1 september 1896,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
15,189_1,When was J. R. Jayewardene born?,j. r. jayewardene was born on 1 september 1896,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
11,189_1,When was J. R. Jayewardene born?,"J.R. Jayewardene was born on April 25, 1919.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,189_1,When was J. R. Jayewardene born?,"J.R. Jayewardene was born on April 25, 1919.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,189_1,When was J. R. Jayewardene born?,"J. R. Jayewardene was born on April 23, 1931.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,189_1,When was J. R. Jayewardene born?,"J. R. Jayewardene was born on April 23, 1931.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,189_1,When was J. R. Jayewardene born?,J. R. Jayewardene was born in 1948.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
79,189_1,When was J. R. Jayewardene born?,J. R. Jayewardene was born in 1948.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,189_2,Where did J. R. Jayewardene grow up?,J. R. Jayewardene was born in Colombo.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
15,189_2,Where did J. R. Jayewardene grow up?,J. R. Jayewardene was born in Colombo.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
77,189_2,Where did J. R. Jayewardene grow up?,"J. R. Jayewardene was born in Colombo, Sri Lanka.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,the answer does not indicate where he grew up but rather his place of birth,false,true,,
11,189_2,Where did J. R. Jayewardene grow up?,"J. R. Jayewardene was born in Colombo, Sri Lanka.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,189_2,Where did J. R. Jayewardene grow up?,"J. R. Jayewardene was born in Dharmapala Mawatha, Colombo.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,189_2,Where did J. R. Jayewardene grow up?,"J. R. Jayewardene was born in Dharmapala Mawatha, Colombo.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,189_3,Where did J. R. Jayewardene go to school?,"Raised by an English nanny, J. R. Jayewardene received his primary education at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
22,189_3,Where did J. R. Jayewardene go to school?,"Raised by an English nanny, J. R. Jayewardene received his primary education at Bishop's College, Colombo and attended Royal College, Colombo for his secondary education.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
21,189_3,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene entered the University College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,189_3,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene entered the University College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,189_3,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene was educated at St. Joseph's College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,189_3,Where did J. R. Jayewardene go to school?,"J. R. Jayewardene was educated at St. Joseph's College, Colombo.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,189_3,Where did J. R. Jayewardene go to school?,J. R. Jayewardene was educated at the Royal College of Music in Colombo.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,189_3,Where did J. R. Jayewardene go to school?,J. R. Jayewardene was educated at the Royal College of Music in Colombo.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,189_7,Who were J. R. Jayewardene's parents?,J. R. R. Jayewardene's parents were J. R. Jayewardene Sr. and Anuradasa Jayewardene.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,189_7,Who were J. R. Jayewardene's parents?,J. R. R. Jayewardene's parents were J. R. Jayewardene Sr. and Anuradasa Jayewardene.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,189_7,Who were J. R. Jayewardene's parents?,"J. R. Jayewardene's parents were Hon. Justice Wilfred Jayewardene KC, a Judge of Supreme Court of Ceylon and Agnes Helen Don Philip Wijewardena daughter of Tudugalage Muhandiram Don Philip Wijewardena a wealthy merchant.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,189_7,Who were J. R. Jayewardene's parents?,"J. R. Jayewardene's parents were Hon. Justice Wilfred Jayewardene KC, a Judge of Supreme Court of Ceylon and Agnes Helen Don Philip Wijewardena daughter of Tudugalage Muhandiram Don Philip Wijewardena a wealthy merchant.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,189_7,Who were J. R. Jayewardene's parents?,J. R. Jayewardene's parents were J. R. Jayewardene Sr. and Ananda Jayewardene.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
40,189_7,Who were J. R. Jayewardene's parents?,J. R. Jayewardene's parents were J. R. Jayewardene Sr. and Ananda Jayewardene.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,189_7,Who were J. R. Jayewardene's parents?,His parents were J. R. Jayewardene and A. M. Jayewardene.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,189_7,Who were J. R. Jayewardene's parents?,His parents were J. R. Jayewardene and A. M. Jayewardene.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
82,189_7,Who were J. R. Jayewardene's parents?,"J. R. Jayewardene was the eldest of 11 children, of Hon. Justice Wilfred Jayewardene KC, a Judge of Supreme Court of Ceylon and Agnes Helen Don Philip Wijewardena a wealthy merchant.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,189_7,Who were J. R. Jayewardene's parents?,"J. R. Jayewardene was the eldest of 11 children, of Hon. Justice Wilfred Jayewardene KC, a Judge of Supreme Court of Ceylon and Agnes Helen Don Philip Wijewardena a wealthy merchant.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,189_7,Who were J. R. Jayewardene's parents?,J. R. Jayewardene's parents were Junius Richard Jayewardene and Mary Jayewardene.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,189_7,Who were J. R. Jayewardene's parents?,J. R. Jayewardene's parents were Junius Richard Jayewardene and Mary Jayewardene.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
21,19_1,What is chemical energy?,Chemical energy is the energy produced by chemical reactions.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,19_1,What is chemical energy?,Chemical energy is the energy produced by chemical reactions.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,19_1,What is chemical energy?,Chemical energy is a form of chemical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,correct answer,
9,19_1,What is chemical energy?,Chemical energy is a form of chemical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,random answer,
9,19_1,What is chemical energy?,"Chemical energy is the potential of a chemical substance to undergo a transformation through a chemical reaction to transform other chemical substances. Examples include batteries, food",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,VERY NICE,false,false,,
24,19_1,What is chemical energy?,"Chemical energy is the potential of a chemical substance to undergo a transformation through a chemical reaction to transform other chemical substances. Examples include batteries, food",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
76,19_1,What is chemical energy?,"Chemical energy is energy that is stored in the bonds between chemical compounds, such as atoms and molecules.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,19_1,What is chemical energy?,"Chemical energy is energy that is stored in the bonds between chemical compounds, such as atoms and molecules.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
60,19_1,What is chemical energy?,A person's chemical energy is called chemical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,correct answer,
48,19_1,What is chemical energy?,A person's chemical energy is called chemical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,correct answer,
24,19_1,What is chemical energy?,chemical energy is energy that is stored in the bonds between chemical compounds,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
8,19_1,What is chemical energy?,chemical energy is energy that is stored in the bonds between chemical compounds,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
7,19_1,What is chemical energy?,chemical energy is the name of a chemical reaction that takes place when an active,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
46,19_1,What is chemical energy?,chemical energy is the name of a chemical reaction that takes place when an active,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
25,19_3,How is a chemical reaction represented mathematically?,The symbolic representation of chemical reaction using symbols and formulae is known as Chemical Equation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
9,19_3,How is a chemical reaction represented mathematically?,The symbolic representation of chemical reaction using symbols and formulae is known as Chemical Equation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,confusing answer,
16,19_3,How is a chemical reaction represented mathematically?,"A chemical reaction is represented in terms of the type of reaction and the reactivity of starting materials, and use appropriate symbols and formulae to represent the structure and bonding of chemical substances.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
23,19_3,How is a chemical reaction represented mathematically?,"A chemical reaction is represented in terms of the type of reaction and the reactivity of starting materials, and use appropriate symbols and formulae to represent the structure and bonding of chemical substances.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
6,19_3,How is a chemical reaction represented mathematically?,"A chemical reaction is represented mathematically through symbols and formulae to represent the structure and bonding of chemical substances, and use appropriate symbols and formulae to represent the type of reaction and the reactivity of starting materials.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
36,19_3,How is a chemical reaction represented mathematically?,"A chemical reaction is represented mathematically through symbols and formulae to represent the structure and bonding of chemical substances, and use appropriate symbols and formulae to represent the type of reaction and the reactivity of starting materials.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,19_3,How is a chemical reaction represented mathematically?,A chemical reaction is represented by the following equation:,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,19_3,How is a chemical reaction represented mathematically?,A chemical reaction is represented by the following equation:,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
36,19_3,How is a chemical reaction represented mathematically?,"The chemical reaction is represented mathematically by symbols and formulae to represent the structure and bonding of chemical substances, and use appropriate symbols and formulae to represent the structure and bonding of chemical substances.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,malformed answer,
37,19_3,How is a chemical reaction represented mathematically?,"The chemical reaction is represented mathematically by symbols and formulae to represent the structure and bonding of chemical substances, and use appropriate symbols and formulae to represent the structure and bonding of chemical substances.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,malformed answer,
13,19_3,How is a chemical reaction represented mathematically?,A chemical reaction can be represented mathematically.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
13,19_3,How is a chemical reaction represented mathematically?,A chemical reaction can be represented mathematically.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,random answer,
25,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a substance is broken down into its constituent parts.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
15,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a substance is broken down into its constituent parts.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
75,19_6,What is a decomposition reaction?,A decomposition reaction is when a more complex substance breaks down into its more simple parts.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,good,false,false,,
59,19_6,What is a decomposition reaction?,A decomposition reaction is when a more complex substance breaks down into its more simple parts.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
16,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into smaller components.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into smaller components.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into simpler or more complex elements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
85,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into simpler or more complex elements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a single compound breaks down into two or more simpler substances by a chemical reaction.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
22,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a single compound breaks down into two or more simpler substances by a chemical reaction.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,true,false,random answer,
23,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a chemical substance is broken down into its simpler components.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
72,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a chemical substance is broken down into its simpler components.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
11,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction that involves the breakdown of a compound into smaller pieces.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
26,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction that involves the breakdown of a compound into smaller pieces.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,19_6,What is a decomposition reaction?,It is a decomposition reaction.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,false,true,correct answer,
73,19_6,What is a decomposition reaction?,It is a decomposition reaction.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,random answer,
10,19_6,What is a decomposition reaction?,A decomposition reaction is a reaction in which a substance breaks down into smaller substances.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,19_6,What is a decomposition reaction?,A decomposition reaction is a reaction in which a substance breaks down into smaller substances.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
69,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into simpler elements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
33,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into simpler elements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,GOOD,false,false,,
93,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into its simpler components.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
61,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction in which a compound is broken down into its simpler components.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
8,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction that involves the break down of a complex substance into smaller pieces.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
12,19_6,What is a decomposition reaction?,A decomposition reaction is a chemical reaction that involves the break down of a complex substance into smaller pieces.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
47,19_7,How is a decomposition reaction a chemical change?,"In decomposition reactions, a single compound breaks down into two or more simpler substances.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,Good,false,false,,
6,19_7,How is a decomposition reaction a chemical change?,"In decomposition reactions, a single compound breaks down into two or more simpler substances.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
32,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,confusing answer,
20,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
52,19_7,How is a decomposition reaction a chemical change?,Decomposition is a chemical reaction in which chemical products are decomposed.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,19_7,How is a decomposition reaction a chemical change?,Decomposition is a chemical reaction in which chemical products are decomposed.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
78,19_7,How is a decomposition reaction a chemical change?,Decomposition reactions involve the breaking down of a complex substance into two or more simpler substances.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
34,19_7,How is a decomposition reaction a chemical change?,Decomposition reactions involve the breaking down of a complex substance into two or more simpler substances.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,its is possible,false,false,,
36,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change that occurs when a chemical is broken down into smaller pieces.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
46,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change that occurs when a chemical is broken down into smaller pieces.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change of a substance.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
30,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change of a substance.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
61,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change in the chemistry of a substance.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
26,19_7,How is a decomposition reaction a chemical change?,A decomposition reaction is a chemical change in the chemistry of a substance.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
53,19_7,How is a decomposition reaction a chemical change?,Decomposition is a chemical change that occurs when a chemical is decomposed.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,confusing answer,
21,19_7,How is a decomposition reaction a chemical change?,Decomposition is a chemical change that occurs when a chemical is decomposed.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,confusing answer,
13,19_7,How is a decomposition reaction a chemical change?,Decomposition is a chemical change that occurs when a chemical changes its physical state.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
65,19_7,How is a decomposition reaction a chemical change?,Decomposition is a chemical change that occurs when a chemical changes its physical state.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,19_8,What is a synthesis reaction?,A combination reaction is a reaction where two or more elements or compounds combine to form a single compound. Such reactions may be represented by equations of,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,malformed answer,
12,19_8,What is a synthesis reaction?,A combination reaction is a reaction where two or more elements or compounds combine to form a single compound. Such reactions may be represented by equations of,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
7,19_8,What is a synthesis reaction?,A synthesis reaction occurs when two or more substances combine to form a single compound. Elements or simpler compounds combine to form a more complex organic compound.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,19_8,What is a synthesis reaction?,A synthesis reaction occurs when two or more substances combine to form a single compound. Elements or simpler compounds combine to form a more complex organic compound.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,19_8,What is a synthesis reaction?,A synthesis reaction is a chemical reaction that involves the addition of two or more chemical groups to a single solution.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,19_8,What is a synthesis reaction?,A synthesis reaction is a chemical reaction that involves the addition of two or more chemical groups to a single solution.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,19_8,What is a synthesis reaction?,A synthesis reaction is a chemical reaction in which a mixture of two or more reactants is created.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
111,19_8,What is a synthesis reaction?,A synthesis reaction is a chemical reaction in which a mixture of two or more reactants is created.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,"A combination reaction, also called a synthesis reaction occurs when two or more reactants combine to form a single compound.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
16,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,"A combination reaction, also called a synthesis reaction occurs when two or more reactants combine to form a single compound.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
26,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis is a chemical reaction in which two substances combine to form a single compound. Decomposition occurs when two substances combine to form a simpler substance.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
21,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis is a chemical reaction in which two substances combine to form a single compound. Decomposition occurs when two substances combine to form a simpler substance.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
39,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction is a reaction in which two or more reactants combine to form a more complex substance. In other words: A + B,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,"This answer tells me what a synthesis reaction is, but it does not mention what decomposition is, or how they are different.",false,true,correct answer,
7,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction is a reaction in which two or more reactants combine to form a more complex substance. In other words: A + B,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,correct answer,
30,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction is a chemical reaction in which a compound is broken down into simpler or more complex elements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,random answer,
42,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction is a chemical reaction in which a compound is broken down into simpler or more complex elements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,correct answer,
93,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction occurs when two or more substances combine to form a single compound. A decomposition reaction occurs when two or more substances are broken down into simpler substances.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
23,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction occurs when two or more substances combine to form a single compound. A decomposition reaction occurs when two or more substances are broken down into simpler substances.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
30,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction occurs when two or more substances combine to form a single compound. Elements or simpler compounds combine to form a more complex compound.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,A synthesis reaction occurs when two or more substances combine to form a single compound. Elements or simpler compounds combine to form a more complex compound.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,Synthesis is a chemical reaction in which a substance is synthesized by the use of a chemical reaction catalyst. Decomposition is a chemical reaction in which a substance is destroyed by the use of a chemical reaction catalyst.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
9,19_9,Tell me the differences between synthesis reaction and decomposition reaction.,Synthesis is a chemical reaction in which a substance is synthesized by the use of a chemical reaction catalyst. Decomposition is a chemical reaction in which a substance is destroyed by the use of a chemical reaction catalyst.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,191_2,What is a Dutch angle?,A Dutch angle is a type of angle that is formed when two lines intersect at a right angle.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,191_2,What is a Dutch angle?,A Dutch angle is a type of angle that is formed when two lines intersect at a right angle.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,191_2,What is a Dutch angle?,A Dutch angle is the difference between a Dutch and a Dutch angle.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
66,191_2,What is a Dutch angle?,A Dutch angle is the difference between a Dutch and a Dutch angle.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,The response seems to answer the question - but makes no sense.,true,false,,
10,191_2,What is a Dutch angle?,"The Dutch angle, also known as Dutch tilt, canted angle, or oblique angle, is a type of camera shot which involves setting the camera at an angle on its roll axis.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,191_2,What is a Dutch angle?,"The Dutch angle, also known as Dutch tilt, canted angle, or oblique angle, is a type of camera shot which involves setting the camera at an angle on its roll axis.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,192_3,What are some examples of kapu in Hawaiian society?,examples of kapu included the provision that men and women could not eat together ( ʻaikapu religion ),rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
7,192_3,What are some examples of kapu in Hawaiian society?,examples of kapu included the provision that men and women could not eat together ( ʻaikapu religion ),rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
27,192_3,What are some examples of kapu in Hawaiian society?,Examples of kapu included the provision that men and women could not eat together (Aellenikapu religion).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
7,192_3,What are some examples of kapu in Hawaiian society?,Examples of kapu included the provision that men and women could not eat together (Aellenikapu religion).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
5,192_3,What are some examples of kapu in Hawaiian society?,"The legal system was based on religious kapu, or taboos. Examples of kapu included the provision that men and women could not eat together.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
29,192_3,What are some examples of kapu in Hawaiian society?,"The legal system was based on religious kapu, or taboos. Examples of kapu included the provision that men and women could not eat together.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
24,194_2,Why was there friction among The Bangles's members?,There was friction among band members after music industry media began singling out Pamela Hoffs as the lead singer of the group.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,194_2,Why was there friction among The Bangles's members?,There was friction among band members after music industry media began singling out Pamela Hoffs as the lead singer of the group.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,194_2,Why was there friction among The Bangles's members?,There was friction among band members after music industry media began singling out Hoffs as the lead singer of the group.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,194_2,Why was there friction among The Bangles's members?,There was friction among band members after music industry media began singling out Hoffs as the lead singer of the group.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
38,194_2,Why was there friction among The Bangles's members?,[20] Breakup (1989) [ edit ] There was friction among band members after music industry media began singling out Hoffs as the lead singer of the group.,simple-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-20-21-01-58,true,,false,false,,
5,194_2,Why was there friction among The Bangles's members?,[20] Breakup (1989) [ edit ] There was friction among band members after music industry media began singling out Hoffs as the lead singer of the group.,simple-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-20-21-01-58,false,,true,false,,
21,194_2,Why was there friction among The Bangles's members?,There was friction among band members after music industry media began singling out Pamela Jean Hoffs as the lead singer of the group.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
4,194_2,Why was there friction among The Bangles's members?,There was friction among band members after music industry media began singling out Pamela Jean Hoffs as the lead singer of the group.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
5,197_4,Did Sachin Tendulkar do well during his debut for Bombay against Gujarat?,making him the youngest indian to score a century on debut in first - class cricket,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
23,197_4,Did Sachin Tendulkar do well during his debut for Bombay against Gujarat?,making him the youngest indian to score a century on debut in first - class cricket,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,The answer is not complete.,true,false,,
17,197_4,Did Sachin Tendulkar do well during his debut for Bombay against Gujarat?,"Sachin Tendulkar scored 100 not out in that match, making him the youngest Indian to score a century on debut in first-class cricket.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,197_4,Did Sachin Tendulkar do well during his debut for Bombay against Gujarat?,"Sachin Tendulkar scored 100 not out in that match, making him the youngest Indian to score a century on debut in first-class cricket.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,197_4,Did Sachin Tendulkar do well during his debut for Bombay against Gujarat?,"Sachin Tendulkar made his debut for Bombay against Gujarat at home and scored 100 not out in that match, making him the youngest Indian to score a century on debut in first-class cricket.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,197_4,Did Sachin Tendulkar do well during his debut for Bombay against Gujarat?,"Sachin Tendulkar made his debut for Bombay against Gujarat at home and scored 100 not out in that match, making him the youngest Indian to score a century on debut in first-class cricket.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
71,2_2,Tell me about boer goats,The Boer goat is a breed of goat that was developed in South Africa in the early 1900s and is a popular breed for meat production.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
35,2_2,Tell me about boer goats,The Boer goat is a breed of goat that was developed in South Africa in the early 1900s and is a popular breed for meat production.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
32,2_2,Tell me about boer goats,Boer Goat is a breed of goat that was developed in South Africa in the early 1900s for meat production.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
49,2_2,Tell me about boer goats,Boer Goat is a breed of goat that was developed in South Africa in the early 1900s for meat production.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,2_2,Tell me about boer goats,Boer goats are a breed of goats from South Africa.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,2_2,Tell me about boer goats,Boer goats are a breed of goats from South Africa.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,2_2,Tell me about boer goats,The Boer goat is a breed of goat that was developed in South Africa in the early 1900s for meat production. Their name is derived from,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,correct answer,
7,2_2,Tell me about boer goats,The Boer goat is a breed of goat that was developed in South Africa in the early 1900s for meat production. Their name is derived from,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
15,2_2,Tell me about boer goats,Boer goats are a type of cross breed of goats native to South Africa.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
41,2_2,Tell me about boer goats,Boer goats are a type of cross breed of goats native to South Africa.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,true,false,random answer,
8,2_2,Tell me about boer goats,Boer goats are a type of goat native to South Africa.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
104,2_2,Tell me about boer goats,Boer goats are a type of goat native to South Africa.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
90,2_2,Tell me about boer goats,Boer goats are a breed of goat that originated in South Africa.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,true,false,random answer,
5,2_2,Tell me about boer goats,Boer goats are a breed of goat that originated in South Africa.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
7,2_2,Tell me about boer goats,Boer goats are a type of goat that was introduced to the United States by Europeans in the late 19th and early 20th centuries.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,2_2,Tell me about boer goats,Boer goats are a type of goat that was introduced to the United States by Europeans in the late 19th and early 20th centuries.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
20,2_2,Tell me about boer goats,Boer goats are a cross between the Boer goat and the American Boer goat.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,true,false,random answer,
24,2_2,Tell me about boer goats,Boer goats are a cross between the Boer goat and the American Boer goat.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,good speech,false,false,,
80,2_2,Tell me about boer goats,Boer goats were a Boer livestock species that thrived in South Africa during the Boer War.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
51,2_2,Tell me about boer goats,Boer goats were a Boer livestock species that thrived in South Africa during the Boer War.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
9,2_2,Tell me about boer goats,Boer goats are a cross between the Boer goat and the Eurasian goat.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
52,2_2,Tell me about boer goats,Boer goats are a cross between the Boer goat and the Eurasian goat.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,random answer,
58,2_2,Tell me about boer goats,Boer goats are a type of goat that originated in South Africa between the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
19,2_2,Tell me about boer goats,Boer goats are a type of goat that originated in South Africa between the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
37,2_4,Are angora goats good for meat?,Angora goats are good for meat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
24,2_4,Are angora goats good for meat?,Angora goats are good for meat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,2_4,Are angora goats good for meat?,"According to the United States Department of Agriculture, angora goats are good for meat production in the United States.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,2_4,Are angora goats good for meat?,"According to the United States Department of Agriculture, angora goats are good for meat production in the United States.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
6,2_4,Are angora goats good for meat?,"yes, angora goats are good for meat",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
73,2_4,Are angora goats good for meat?,"yes, angora goats are good for meat",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
5,2_6,What are pygmy goats used for?,"Modern pygmy goats are kept mostly as pets, but they do have some potential for meat.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,2_6,What are pygmy goats used for?,"Modern pygmy goats are kept mostly as pets, but they do have some potential for meat.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
19,2_6,What are pygmy goats used for?,"While Pygmies are most commonly kept as pets or used as food processors, they can also be used for milk production. Pygmies are also used for milk production, but",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
4,2_6,What are pygmy goats used for?,"While Pygmies are most commonly kept as pets or used as food processors, they can also be used for milk production. Pygmies are also used for milk production, but",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
4,2_6,What are pygmy goats used for?,The pygmy goat is used as a source of meat for livestock.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,confusing answer,
45,2_6,What are pygmy goats used for?,The pygmy goat is used as a source of meat for livestock.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,confusing answer,
8,2_6,What are pygmy goats used for?,Pygmy goats are used for dairy research.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,confusing answer,
56,2_6,What are pygmy goats used for?,Pygmy goats are used for dairy research.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,confusing answer,
9,20_3,Tell me about the phospholipid bilayer.,A liposome is a small aqueous compartment surrounded by a lipid bilayer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
89,20_3,Tell me about the phospholipid bilayer.,A liposome is a small aqueous compartment surrounded by a lipid bilayer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,random answer,
39,20_3,Tell me about the phospholipid bilayer.,The lipid bilayer is a thin polar membrane made of two layers of lipid molecules.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
31,20_3,Tell me about the phospholipid bilayer.,The lipid bilayer is a thin polar membrane made of two layers of lipid molecules.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,random answer,
26,20_3,Tell me about the phospholipid bilayer.,The lipid bilayer (or phospholipid bilayer) is a thin polar membrane made of two layers of lipid molecules.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
25,20_3,Tell me about the phospholipid bilayer.,The lipid bilayer (or phospholipid bilayer) is a thin polar membrane made of two layers of lipid molecules.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,NICE,false,false,,
11,20_3,Tell me about the phospholipid bilayer.,The lipid bilayer is a thin polar membrane made of two layers of lipid molecules. These membranes are flat sheets that form a,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,correct answer,
15,20_3,Tell me about the phospholipid bilayer.,The lipid bilayer is a thin polar membrane made of two layers of lipid molecules. These membranes are flat sheets that form a,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,correct answer,
49,20_3,Tell me about the phospholipid bilayer.,Phospholipid bilayer is a type of lipid bilayer that is a type of lipid membrane.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,confusing answer,
7,20_3,Tell me about the phospholipid bilayer.,Phospholipid bilayer is a type of lipid bilayer that is a type of lipid membrane.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,confusing answer,
72,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by British alternative rock band Thirty Seconds to Mars.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
4,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by British alternative rock band Thirty Seconds to Mars.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
15,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by British music producer Mark Ronson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by British music producer Mark Ronson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,200_1,What was Mark Ronson's Here Comes the Fuzz?,Mark Ronson's Here Comes the Fuzz was a song by the British band The Fuzz.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,200_1,What was Mark Ronson's Here Comes the Fuzz?,Mark Ronson's Here Comes the Fuzz was a song by the British band The Fuzz.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
22,200_1,What was Mark Ronson's Here Comes the Fuzz?,"^ "" mark ronson : here comes the fuzz """,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
9,200_1,What was Mark Ronson's Here Comes the Fuzz?,"^ "" mark ronson : here comes the fuzz """,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
55,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by English musician Mark Ronson.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
4,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by English musician Mark Ronson.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
21,200_1,What was Mark Ronson's Here Comes the Fuzz?,here comes the fuzz is the third studio album by music producer mark ronson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
5,200_1,What was Mark Ronson's Here Comes the Fuzz?,here comes the fuzz is the third studio album by music producer mark ronson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
5,200_1,What was Mark Ronson's Here Comes the Fuzz?,"Mark Ronson chronology Here Comes the Fuzz (2003) Version (2007) Singles from Here Comes the Fuzz "" Ooh Wee "" Released: 20 October 2003 ""NYC Rules"" Released: 16 February 2004 Professional ratings Review scores Source Rating AllMusic [1] Blender [2] Entertainment Weekly (C) [3] The Guardian [4] Rolling Stone [5] Here Comes the Fuzz is the debut studio album by British producer Mark Ronson .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
23,200_1,What was Mark Ronson's Here Comes the Fuzz?,"Mark Ronson chronology Here Comes the Fuzz (2003) Version (2007) Singles from Here Comes the Fuzz "" Ooh Wee "" Released: 20 October 2003 ""NYC Rules"" Released: 16 February 2004 Professional ratings Review scores Source Rating AllMusic [1] Blender [2] Entertainment Weekly (C) [3] The Guardian [4] Rolling Stone [5] Here Comes the Fuzz is the debut studio album by British producer Mark Ronson .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,It looks like a copy/paste rather then an answer.,true,false,,
20,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by Mark Ronson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,200_1,What was Mark Ronson's Here Comes the Fuzz?,Here Comes the Fuzz is the debut studio album by Mark Ronson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,200_2,When was Here Comes the Fuzz released?,Here Comes the Fuzz was released on 8 September 2003,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,200_2,When was Here Comes the Fuzz released?,Here Comes the Fuzz was released on 8 September 2003,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,200_2,When was Here Comes the Fuzz released?,"Here Comes the Fuzz is the debut studio album by American rock band the Fuzz, released on October 26, 1971.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,200_2,When was Here Comes the Fuzz released?,"Here Comes the Fuzz is the debut studio album by American rock band the Fuzz, released on October 26, 1971.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,200_2,When was Here Comes the Fuzz released?,here comes the fuzz was released in the uk on 8 september 2003,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
4,200_2,When was Here Comes the Fuzz released?,here comes the fuzz was released in the uk on 8 september 2003,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
16,200_2,When was Here Comes the Fuzz released?,Here Comes the Fuzz is the debut studio album by British producer Mark Ronson. The album was released on 8 September 2003.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,200_2,When was Here Comes the Fuzz released?,Here Comes the Fuzz is the debut studio album by British producer Mark Ronson. The album was released on 8 September 2003.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
32,200_7,What did Mark Ronson do after the album Here Comes the Fuzz?,"After Here Comes the Fuzz, Mark Ronson signed a record contract with Elektra Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,200_7,What did Mark Ronson do after the album Here Comes the Fuzz?,"After Here Comes the Fuzz, Mark Ronson signed a record contract with Elektra Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
9,200_7,What did Mark Ronson do after the album Here Comes the Fuzz?,"Two weeks after releasing Here Comes the Fuzz, Elektra Records dropped Mark Ronson.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,200_7,What did Mark Ronson do after the album Here Comes the Fuzz?,"Two weeks after releasing Here Comes the Fuzz, Elektra Records dropped Mark Ronson.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
7,200_7,What did Mark Ronson do after the album Here Comes the Fuzz?,"After Here Comes the Fuzz was released, Mark Ronson signed a record contract with Elektra Records.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,200_7,What did Mark Ronson do after the album Here Comes the Fuzz?,"After Here Comes the Fuzz was released, Mark Ronson signed a record contract with Elektra Records.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,201_1,When did Gerald Ford pardon Richard Nixon?," Gerald Ford pardoned Richard Nixon on September 8, 1974.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,201_1,When did Gerald Ford pardon Richard Nixon?," Gerald Ford pardoned Richard Nixon on September 8, 1974.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Ford pardoned Nixon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
25,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Ford pardoned Nixon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
35,201_1,When did Gerald Ford pardon Richard Nixon?,"Nixon pardoned Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
6,201_1,When did Gerald Ford pardon Richard Nixon?,"Nixon pardoned Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
19,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald R. Ford pardoned Richard Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald R. Ford pardoned Richard Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Gerald R. Ford pardoned Richard Nixon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Gerald R. Ford pardoned Richard Nixon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, Gerald Ford issued a full and unconditional pardon of Richard Nixon for any crimes he had committed or taken part in as president.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, Gerald Ford issued a full and unconditional pardon of Richard Nixon for any crimes he had committed or taken part in as president.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Ford issued a full and unconditional pardon of Nixon for any crimes he had committed or taken part in as president.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
15,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Ford issued a full and unconditional pardon of Nixon for any crimes he had committed or taken part in as president.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
9,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald Ford pardoned Richard Nixon on August 9, 1974.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald Ford pardoned Richard Nixon on August 9, 1974.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald Ford pardoned Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald Ford pardoned Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
30,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Gerald R. Ford issued Proclamation 4311, which gave Richard M. Nixon a full and unconditional pardon for any crimes he might have committed against the United States while president.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
19,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, President Gerald R. Ford issued Proclamation 4311, which gave Richard M. Nixon a full and unconditional pardon for any crimes he might have committed against the United States while president.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
17,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald R. Ford issued a full and unconditional pardon of Richard Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,201_1,When did Gerald Ford pardon Richard Nixon?,"Gerald R. Ford issued a full and unconditional pardon of Richard Nixon on September 8, 1974.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,201_1,When did Gerald Ford pardon Richard Nixon?,"in 1974, gerald ford pardoned richard nixon for his role in",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
20,201_1,When did Gerald Ford pardon Richard Nixon?,"in 1974, gerald ford pardoned richard nixon for his role in",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,INCOMPLETE SENTENCE,false,false,,
18,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, Gerald R. Ford issued a Presidential Pardon in the mail to Richard M. Nixon.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,201_1,When did Gerald Ford pardon Richard Nixon?,"On September 8, 1974, Gerald R. Ford issued a Presidential Pardon in the mail to Richard M. Nixon.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
32,201_1,When did Gerald Ford pardon Richard Nixon?,presidential proclamation 4311 by president gerald r. ford granting a pardon to richard m. nixon,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,201_1,When did Gerald Ford pardon Richard Nixon?,presidential proclamation 4311 by president gerald r. ford granting a pardon to richard m. nixon,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
14,203_6,did Colin Cowdrey play in New Zealand?,Colin Cowdrey made few runs in a low scoring series in which England easily won both Tests.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,203_6,did Colin Cowdrey play in New Zealand?,Colin Cowdrey made few runs in a low scoring series in which England easily won both Tests.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
23,203_6,did Colin Cowdrey play in New Zealand?,"Colin Cowdrey played in New Zealand, but Alastair Cook made few runs in a low scoring series in which England easily won both Tests.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,203_6,did Colin Cowdrey play in New Zealand?,"Colin Cowdrey played in New Zealand, but Alastair Cook made few runs in a low scoring series in which England easily won both Tests.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,203_6,did Colin Cowdrey play in New Zealand?,but cowdrey made few runs in a low scoring series in which england easily won both tests,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
8,203_6,did Colin Cowdrey play in New Zealand?,but cowdrey made few runs in a low scoring series in which england easily won both tests,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
12,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American R&B singer T-Pain, released on October 26, 2002.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American R&B singer T-Pain, released on October 26, 2002.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,205_1,When was Epiphany by T-Pain released?,"Epiphany was released on June 5, 2007.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,205_1,When was Epiphany by T-Pain released?,"Epiphany was released on June 5, 2007.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American hip hop artist T-Pain, released on June 5, 2007.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
23,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American hip hop artist T-Pain, released on June 5, 2007.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
17,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American rapper and singer T-Pain. It was released on June 5, 2007.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
116,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American rapper and singer T-Pain. It was released on June 5, 2007.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
5,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American rapper T-Pain. It was released on June 5, 2007.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,205_1,When was Epiphany by T-Pain released?,"Epiphany is the second studio album by American rapper T-Pain. It was released on June 5, 2007.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
20,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,"In 2008, the single Good Life with Kanye West won a Grammy Award for Best Rap Song.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,"In 2008, the single Good Life with Kanye West won a Grammy Award for Best Rap Song.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
21,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,Good Life won the Grammy Award for Best Rap Song in 2008.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
7,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,Good Life won the Grammy Award for Best Rap Song in 2008.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,"In 2008, T-Pain's single Good Life with Kanye West won a Grammy Award for Best Rap Song.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,"In 2008, T-Pain's single Good Life with Kanye West won a Grammy Award for Best Rap Song.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,T-Pain won the grammy award for best rap song with Kanye West for Good Life in 2009.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,205_8,What year did T-Pain win the Grammy Award for Best Rap Song with Kanye West for Good Life?,T-Pain won the grammy award for best rap song with Kanye West for Good Life in 2009.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,206_5,Who starred in Tod Browning's Jim Bludso (1917)?,Silent Jim Bludso starred Wilfred Lucas.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,206_5,Who starred in Tod Browning's Jim Bludso (1917)?,Silent Jim Bludso starred Wilfred Lucas.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,206_5,Who starred in Tod Browning's Jim Bludso (1917)?,Jim Bludso (1917) stars Wilfred Lucas.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
22,206_5,Who starred in Tod Browning's Jim Bludso (1917)?,Jim Bludso (1917) stars Wilfred Lucas.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
28,206_5,Who starred in Tod Browning's Jim Bludso (1917)?,Tod Browning's Jim Bludso (1917) starred Wilfred Lucas,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,206_5,Who starred in Tod Browning's Jim Bludso (1917)?,Tod Browning's Jim Bludso (1917) starred Wilfred Lucas,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
55,207_3,who were the members of ZZ Top,"ZZ Top consisted of Dusty Hill, Frank Beard, and Billy Gibbons.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,"ZZ Top is an American rock band formed in 1969 in Houston, Texas.",false,false,,
11,207_3,who were the members of ZZ Top,"ZZ Top consisted of Dusty Hill, Frank Beard, and Billy Gibbons.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
23,207_3,who were the members of ZZ Top,"ZZ Top consisted of Billy Ethridge, Dusty Hill, and Frank Beard.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,207_3,who were the members of ZZ Top,"ZZ Top consisted of Billy Ethridge, Dusty Hill, and Frank Beard.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,207_3,who were the members of ZZ Top,Billy Gibbons and Dusty Hill formed ZZ Top in 1969.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,207_3,who were the members of ZZ Top,Billy Gibbons and Dusty Hill formed ZZ Top in 1969.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,207_3,who were the members of ZZ Top,"ZZ Top consisted of lead vocalist Dusty Springfield, guitarist Billy Gibbons, and drummer Frank Beard.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
32,207_3,who were the members of ZZ Top,"ZZ Top consisted of lead vocalist Dusty Springfield, guitarist Billy Gibbons, and drummer Frank Beard.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,VERY EASY,false,false,,
35,207_3,who were the members of ZZ Top,"ZZ Top has, since 1970, consisted of vocalist/guitarist Billy Gibbons, bassist/vocalist Dusty Hill, and drummer Frank Beard.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,207_3,who were the members of ZZ Top,"ZZ Top has, since 1970, consisted of vocalist/guitarist Billy Gibbons, bassist/vocalist Dusty Hill, and drummer Frank Beard.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,208_1,Where was Teena Marie born?,"Teena Marie was born in Los Angeles, California.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,208_1,Where was Teena Marie born?,"Teena Marie was born in Los Angeles, California.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,GOOD,false,false,,
8,208_1,Where was Teena Marie born?,"teena marie was born in santa clarita, california",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
9,208_1,Where was Teena Marie born?,"teena marie was born in santa clarita, california",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
21,208_1,Where was Teena Marie born?,"Teena Marie was born Mary Christine Brockert on March 5, 1956 in Santa Monica, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
23,208_1,Where was Teena Marie born?,"Teena Marie was born Mary Christine Brockert on March 5, 1956 in Santa Monica, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
30,208_1,Where was Teena Marie born?,"Teena Marie was born Mary Christine Brockert in Santa Monica, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,208_1,Where was Teena Marie born?,"Teena Marie was born Mary Christine Brockert in Santa Monica, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,209_1,what is Nelly Furtado's loose?,nelly furtado's loose is the sixth studio album by canadian singer,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
14,209_1,what is Nelly Furtado's loose?,nelly furtado's loose is the sixth studio album by canadian singer,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
50,209_1,what is Nelly Furtado's loose?,Nelly Furtado's loose is a song by Nelly Furtado.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,true,false,,
12,209_1,what is Nelly Furtado's loose?,Nelly Furtado's loose is a song by Nelly Furtado.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
54,209_1,what is Nelly Furtado's loose?,Loose is the second studio album by Canadian singer Nelly Furtado.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
14,209_1,what is Nelly Furtado's loose?,Loose is the second studio album by Canadian singer Nelly Furtado.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,NICE,false,false,,
67,209_1,what is Nelly Furtado's loose?,"Nelly Furtado's second studio album, Loose, was released on September 25, 2008.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,209_1,what is Nelly Furtado's loose?,"Nelly Furtado's second studio album, Loose, was released on September 25, 2008.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,209_1,what is Nelly Furtado's loose?,Loose is Nelly Furtado's third studio album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,209_1,what is Nelly Furtado's loose?,Loose is Nelly Furtado's third studio album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
118,21_1,What is weathering?,"Weathering is the breaking down of rocks, soil, and minerals as well as wood and artificial materials through contact with the Earth's atmosphere, water,",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
31,21_1,What is weathering?,"Weathering is the breaking down of rocks, soil, and minerals as well as wood and artificial materials through contact with the Earth's atmosphere, water,",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
12,21_1,What is weathering?,"Weathering is breaking down rocks, soil, and minerals as well as wood and artificial materials by contacting the atmosphere, water, and biological organisms of the Earth.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
8,21_1,What is weathering?,"Weathering is breaking down rocks, soil, and minerals as well as wood and artificial materials by contacting the atmosphere, water, and biological organisms of the Earth.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
35,21_1,What is weathering?,Weathering is the process by which rocks break down.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,21_1,What is weathering?,Weathering is the process by which rocks break down.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,21_3,Tell me about chemical weathering.,"Chemical weathering is the process by which rocks are broken down by chemical reactions.... When iron in rocks reacts with oxygen, it forms iron oxide",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
11,21_3,Tell me about chemical weathering.,"Chemical weathering is the process by which rocks are broken down by chemical reactions.... When iron in rocks reacts with oxygen, it forms iron oxide",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,very nice,false,false,,
73,21_3,Tell me about chemical weathering.,Chemical weathering is the breakdown of rocks by the action of water and other chemicals.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,21_3,Tell me about chemical weathering.,Chemical weathering is the breakdown of rocks by the action of water and other chemicals.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,21_3,Tell me about chemical weathering.,Chemical weathering is the process of weathering caused by the deposition of chemical substances in the Earth's crust.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,21_3,Tell me about chemical weathering.,Chemical weathering is the process of weathering caused by the deposition of chemical substances in the Earth's crust.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,good,false,false,,
7,21_4,How is chemical weathering different from biological weathering?,Biological weathering is weathering caused by plants and animals. Plants and animals release acid forming chemicals that cause weathering and also contribute to the,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,confusing answer,
26,21_4,How is chemical weathering different from biological weathering?,Biological weathering is weathering caused by plants and animals. Plants and animals release acid forming chemicals that cause weathering and also contribute to the,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,confusing answer,
40,21_4,How is chemical weathering different from biological weathering?,"Chemical weathering involves the direct effect in the breakdown of rocks, soils and minerals of atmospheric chemicals or biologically produced chemicals also known as biological weathering.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
45,21_4,How is chemical weathering different from biological weathering?,"Chemical weathering involves the direct effect in the breakdown of rocks, soils and minerals of atmospheric chemicals or biologically produced chemicals also known as biological weathering.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,random answer,
4,21_4,How is chemical weathering different from biological weathering?,Biological weathering is the breakdown of rocks by the action of living organisms.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,21_4,How is chemical weathering different from biological weathering?,Biological weathering is the breakdown of rocks by the action of living organisms.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,21_5,Does weathering change the composition of rocks?,Weathering changes the composition of rocks.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,21_5,Does weathering change the composition of rocks?,Weathering changes the composition of rocks.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,good,false,false,,
10,21_5,Does weathering change the composition of rocks?,"Chemical weathering changes the composition of rocks, often transforming them into different chemical reactions when water interacts with minerals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
26,21_5,Does weathering change the composition of rocks?,"Chemical weathering changes the composition of rocks, often transforming them into different chemical reactions when water interacts with minerals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
27,21_5,Does weathering change the composition of rocks?,"Chemical Weathering Chemical weathering changes rock composition, often transforming them into different chemical reactions when water interacts with minerals.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
11,21_5,Does weathering change the composition of rocks?,"Chemical Weathering Chemical weathering changes rock composition, often transforming them into different chemical reactions when water interacts with minerals.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
18,21_5,Does weathering change the composition of rocks?,"Weathering changes the composition of rocks, often transforming them into different chemical reactions when water interacts with minerals.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,21_5,Does weathering change the composition of rocks?,"Weathering changes the composition of rocks, often transforming them into different chemical reactions when water interacts with minerals.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,verynice,false,false,correct answer,
9,211_1,What is Frankie Laine's That's My Desire?,That's My Desire is a song by Frankie Laine.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,211_1,What is Frankie Laine's That's My Desire?,That's My Desire is a song by Frankie Laine.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,211_1,What is Frankie Laine's That's My Desire?,"Frankie Laine's That's My Desire is a song by American singer, songwriter, and actor whose career spanned nearly 75 years, from his first concerts in 1930 with a marathon dance company to his final performance of That's My Desire in 2005.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
29,211_1,What is Frankie Laine's That's My Desire?,"Frankie Laine's That's My Desire is a song by American singer, songwriter, and actor whose career spanned nearly 75 years, from his first concerts in 1930 with a marathon dance company to his final performance of That's My Desire in 2005.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
27,211_1,What is Frankie Laine's That's My Desire?,That's My Desire is a song by American singer-songwriter Frankie Laine.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,211_1,What is Frankie Laine's That's My Desire?,That's My Desire is a song by American singer-songwriter Frankie Laine.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,GOOD,false,false,,
16,211_2,Was Frankie Laine's That's My Desire a success?,"That's My Desire became Frankie Laine's biggest hit, peaking at No. 1 on the Billboard Hot 100.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,211_2,Was Frankie Laine's That's My Desire a success?,"That's My Desire became Frankie Laine's biggest hit, peaking at No. 1 on the Billboard Hot 100.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,211_2,Was Frankie Laine's That's My Desire a success?,Frankie Laine's That's My Desire reached No. 1 on the Billboard Hot 100 and No. 1 on the Top R&B/Hip-Hop Singles.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
24,211_2,Was Frankie Laine's That's My Desire a success?,Frankie Laine's That's My Desire reached No. 1 on the Billboard Hot 100 and No. 1 on the Top R&B/Hip-Hop Singles.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,211_2,Was Frankie Laine's That's My Desire a success?,Frankie Laine's That's My Desire was a #1 hit on the Billboard R&B chart for six weeks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,211_2,Was Frankie Laine's That's My Desire a success?,Frankie Laine's That's My Desire was a #1 hit on the Billboard R&B chart for six weeks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,212_1,Did Ian Botham play at Somerset?,Ian Botham played for Somerset Cricket Club.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
57,212_1,Did Ian Botham play at Somerset?,Ian Botham played for Somerset Cricket Club.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
17,212_1,Did Ian Botham play at Somerset?,Ian Botham played for Somerset County Cricket Club.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
25,212_1,Did Ian Botham play at Somerset?,Ian Botham played for Somerset County Cricket Club.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,212_1,Did Ian Botham play at Somerset?,Ian Botham played for Somerset County Cricket Club.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,212_1,Did Ian Botham play at Somerset?,Ian Botham played for Somerset County Cricket Club.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
26,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham is the only player in English cricket to score more than 1,000 runs in both Test and One Day International (ODI) cricket.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham is the only player in English cricket to score more than 1,000 runs in both Test and One Day International (ODI) cricket.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
22,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham is the only cricketer in England to have scored more than 10,000 runs in a calendar year.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
32,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham is the only cricketer in England to have scored more than 10,000 runs in a calendar year.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham is the only cricketer in Test history to score more than 10,000 runs in a single season.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham is the only cricketer in Test history to score more than 10,000 runs in a single season.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
4,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham was the outstanding performer again, taking seven for 48 which gave him match figures of thirteen for 106. Geoffrey Boycott and Graham Gooch scored the necessary runs for England to win by ten wickets with a day to spare.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
41,212_5,Are there any other interesting aspects about the Ian Botham article?,"Ian Botham was the outstanding performer again, taking seven for 48 which gave him match figures of thirteen for 106. Geoffrey Boycott and Graham Gooch scored the necessary runs for England to win by ten wickets with a day to spare.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,good,false,false,,
25,219_3,Did Danny DeVito win any awards or recognition for his acting?,"Danny DeVito gained prominence for his portrayal of the taxi dispatcher Frank Reynolds on the FX sitcom Hercules, which won him a Golden Globe Award and an Emmy Award.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
33,219_3,Did Danny DeVito win any awards or recognition for his acting?,"Danny DeVito gained prominence for his portrayal of the taxi dispatcher Frank Reynolds on the FX sitcom Hercules, which won him a Golden Globe Award and an Emmy Award.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
37,219_3,Did Danny DeVito win any awards or recognition for his acting?,"Danny DeVito gained prominence for his portrayal of the taxi dispatcher in the television series Taxi, which won him a Golden Globe Award and an Emmy Award.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,"(born November 17, 1944) is an American actor, comedian, director, producer, and screenwriter. He gained prominence for his portrayal of the taxi dispatcher Louie De Palma in the television series Taxi (1978–1983), which won him a Golden Globe Award and an Emmy Award.",false,false,,
24,219_3,Did Danny DeVito win any awards or recognition for his acting?,"Danny DeVito gained prominence for his portrayal of the taxi dispatcher in the television series Taxi, which won him a Golden Globe Award and an Emmy Award.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,GOOD,false,false,,
53,219_3,Did Danny DeVito win any awards or recognition for his acting?,Danny DeVito is best known for his role as Louie De Palma in the 1978-83 television series Taxi.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,"Though related, the response does not clearly answer the question. So, I've selected ""No"".",false,true,,
8,219_3,Did Danny DeVito win any awards or recognition for his acting?,Danny DeVito is best known for his role as Louie De Palma in the 1978-83 television series Taxi.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,219_3,Did Danny DeVito win any awards or recognition for his acting?,Danny DeVito won an Emmy Award for his role as Louie De Palma in the 1978-83 television series Taxi.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,219_3,Did Danny DeVito win any awards or recognition for his acting?,Danny DeVito won an Emmy Award for his role as Louie De Palma in the 1978-83 television series Taxi.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,22_10,What is the most expensive spice and why?,Saffron is the most expensive spice in the world.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
31,22_10,What is the most expensive spice and why?,Saffron is the most expensive spice in the world.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
22,22_10,What is the most expensive spice and why?,"As the most expensive spice in India, saffron is considered to be one of the most valuable spices in the world due to its therapeutic properties.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,22_10,What is the most expensive spice and why?,"As the most expensive spice in India, saffron is considered to be one of the most valuable spices in the world due to its therapeutic properties.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
49,22_10,What is the most expensive spice and why?,"As the most expensive spice in the world, you may wonder if saffron is worth it, and you might wonder what it tastes like.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
11,22_10,What is the most expensive spice and why?,"As the most expensive spice in the world, you may wonder if saffron is worth it, and you might wonder what it tastes like.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,VERY NICE,false,true,confusing answer,
33,22_10,What is the most expensive spice and why?,"saffron is one of the most expensive spices in the world, which is mostly why it is used sparingly.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,very nice,false,false,,
27,22_10,What is the most expensive spice and why?,"saffron is one of the most expensive spices in the world, which is mostly why it is used sparingly.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,22_10,What is the most expensive spice and why?,The most expensive spice is saffron. It is used in many dishes and is very expensive.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
67,22_10,What is the most expensive spice and why?,The most expensive spice is saffron. It is used in many dishes and is very expensive.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,true,false,random answer,
36,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, with some spices in the cool climates of South Africa and Western New South Wales.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
31,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, with some spices in the cool climates of South Africa and Western New South Wales.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
44,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, with some thriving in the cool misty highlands. Most of the seed spices come",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,good,false,false,,
14,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, with some thriving in the cool misty highlands. Most of the seed spices come",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
8,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, such as Northern India and the Middle East.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
30,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, such as Northern India and the Middle East.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, with some areas in the cool highlands.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
17,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, with some areas in the cool highlands.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
44,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, such as coriander seed, wheat and Sumatra highlands.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,good,false,false,,
30,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, such as coriander seed, wheat and Sumatra highlands.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,22_4,Where do most spices come from?,Most spices are grown in the tropical highlands of Northern India and the cool-climate regions of South Africa and Western Australia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
45,22_4,Where do most spices come from?,Most spices are grown in the tropical highlands of Northern India and the cool-climate regions of South Africa and Western Australia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
22,22_4,Where do most spices come from?,"most spices are grown in the tropical regions of the world, with some thriving in the",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
41,22_4,Where do most spices come from?,"most spices are grown in the tropical regions of the world, with some thriving in the",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,random answer,
17,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, such as coriander seed, wheat and misty wheat highlands.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,22_4,Where do most spices come from?,"Most spices are grown in the tropical regions of the world, such as coriander seed, wheat and misty wheat highlands.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
24,22_4,Where do most spices come from?,Most spices are grown in the tropical regions of the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,very nice,false,false,correct answer,
21,22_4,Where do most spices come from?,Most spices are grown in the tropical regions of the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,22_7,Tell me about turmeric.,Turmeric is one of the most popular Indian spices.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,22_7,Tell me about turmeric.,Turmeric is one of the most popular Indian spices.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,22_7,Tell me about turmeric.,Turmeric is an Indian spice blend.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,NA,false,false,,
14,22_7,Tell me about turmeric.,Turmeric is an Indian spice blend.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
40,22_7,Tell me about turmeric.,"In Indian cuisine, turmeric is often used as a spice.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,22_7,Tell me about turmeric.,"In Indian cuisine, turmeric is often used as a spice.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
43,22_7,Tell me about turmeric.,Turmeric is an Indian spice.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
88,22_7,Tell me about turmeric.,Turmeric is an Indian spice.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
21,22_7,Tell me about turmeric.,Turmeric is a spice that is used in Indian cooking.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
82,22_7,Tell me about turmeric.,Turmeric is a spice that is used in Indian cooking.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
24,22_8,Are there any benefits of consuming turmeric?,"Consuming turmeric is one of the benefits of taking a holistic supplement. It is also known as curcumin, which is used to help keep energy in the body",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,confusing answer,
6,22_8,Are there any benefits of consuming turmeric?,"Consuming turmeric is one of the benefits of taking a holistic supplement. It is also known as curcumin, which is used to help keep energy in the body",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,confusing answer,
10,22_8,Are there any benefits of consuming turmeric?,"Research has shown that it contains compounds with medicinal properties, the most important of which is curcumin, the main active ingredient in turmeric.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
83,22_8,Are there any benefits of consuming turmeric?,"Research has shown that it contains compounds with medicinal properties, the most important of which is curcumin, the main active ingredient in turmeric.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
52,22_8,Are there any benefits of consuming turmeric?,"Turmeric has many benefits. It is used to treat arthritis, inflammation, and cancer.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,22_8,Are there any benefits of consuming turmeric?,"Turmeric has many benefits. It is used to treat arthritis, inflammation, and cancer.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,22_8,Are there any benefits of consuming turmeric?,Turmeric has been shown to have anti-inflammatory and antioxidant properties.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,Yes,false,false,,
13,22_8,Are there any benefits of consuming turmeric?,Turmeric has been shown to have anti-inflammatory and antioxidant properties.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,22_8,Are there any benefits of consuming turmeric?,Turmeric is widely known for its anti-inflammatory properties.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
95,22_8,Are there any benefits of consuming turmeric?,Turmeric is widely known for its anti-inflammatory properties.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
21,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"2004: Political protest, Jackie O [ edit ] During 2003, Frenzal Rhomb's McDougall organised Rock Against Howard , a compilation album, by various Australian musicians as a protest against incumbent Prime Minister John Howard 's government.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
41,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"2004: Political protest, Jackie O [ edit ] During 2003, Frenzal Rhomb's McDougall organised Rock Against Howard , a compilation album, by various Australian musicians as a protest against incumbent Prime Minister John Howard 's government.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,EASY,false,false,,
17,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"Frenzal Rhomb's Rock Against Howard was a compilation album, by various Australian musicians as a protest against incumbent Prime Minister, John Howard's government.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"Frenzal Rhomb's Rock Against Howard was a compilation album, by various Australian musicians as a protest against incumbent Prime Minister, John Howard's government.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"Frenzal Rhomb's Lindsay McDougall organised Rock Against Howard, a compilation album, by various Australian musicians as a protest against incumbent Prime Minister, John Howard's government.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"Frenzal Rhomb's Lindsay McDougall organised Rock Against Howard, a compilation album, by various Australian musicians as a protest against incumbent Prime Minister, John Howard's government.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"During 2003 Lindsay McDougall organised Rock Against Howard, a compilation album, by various Australian musicians as a protest against incumbent Prime Minister, John Howard's government.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
60,220_3,what is the name of the album Frenzal Rhomb's Lindsay McDougall organisedthat protested incumbent Prime Minister John Howard's government?,"During 2003 Lindsay McDougall organised Rock Against Howard, a compilation album, by various Australian musicians as a protest against incumbent Prime Minister, John Howard's government.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,NICE,false,false,,
55,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live is a concert series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
11,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live is a concert series.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,NICE,false,false,,
11,221_5,What was Sarah Geronimo's Sarah G Live?,"Sarah Geronimo's Sarah G Live is a reality television show that aired on ABS-CBN on January 3, 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,221_5,What was Sarah Geronimo's Sarah G Live?,"Sarah Geronimo's Sarah G Live is a reality television show that aired on ABS-CBN on January 3, 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,GOOD,false,false,,
15,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live is a musical variety show aired on ABS-CBN. It was co-hosted by Sarah Geronimo and Luis Manzano.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
20,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live is a musical variety show aired on ABS-CBN. It was co-hosted by Sarah Geronimo and Luis Manzano.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
20,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah Geronimo's Sarah G Live was a live concert.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
12,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah Geronimo's Sarah G Live was a live concert.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,NICE,false,false,,
17,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah Geronimo's Sarah G Live is a concert series.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
22,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah Geronimo's Sarah G Live is a concert series.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,221_5,What was Sarah Geronimo's Sarah G Live?,"Sarah Geronimo's Sarah G Live is a reality show that aired on ABS-CBN on January 3, 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,221_5,What was Sarah Geronimo's Sarah G Live?,"Sarah Geronimo's Sarah G Live is a reality show that aired on ABS-CBN on January 3, 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
35,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live is a musical variety show hosted by Sarah Geronimo.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live is a musical variety show hosted by Sarah Geronimo.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,GOOD,false,false,,
13,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G. Live was a singing and dancing musical show in the Philippines hosted by Sarah Geronimo.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
25,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G. Live was a singing and dancing musical show in the Philippines hosted by Sarah Geronimo.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
18,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G. Live was a musical variety show in the Philippines hosted by Sarah Geronimo.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G. Live was a musical variety show in the Philippines hosted by Sarah Geronimo.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
20,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live was a concert that Sarah Geronimo held in the year 2000.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
38,221_5,What was Sarah Geronimo's Sarah G Live?,Sarah G Live was a concert that Sarah Geronimo held in the year 2000.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,222_5,When did Jacqueline Fernandez have her breakthrough?,"Fernandez had her breakthrough role with the psychological thriller Murder 2, her first commercial success.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,222_5,When did Jacqueline Fernandez have her breakthrough?,"Fernandez had her breakthrough role with the psychological thriller Murder 2, her first commercial success.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
16,222_5,When did Jacqueline Fernandez have her breakthrough?,"Jacqueline Fernandez had her breakthrough role with the psychological thriller Murder 2 (2011), her first commercial success.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,222_5,When did Jacqueline Fernandez have her breakthrough?,"Jacqueline Fernandez had her breakthrough role with the psychological thriller Murder 2 (2011), her first commercial success.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,222_5,When did Jacqueline Fernandez have her breakthrough?,fernandez had her breakthrough role with the psychological thriller murder 2 ( 2011 ),rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
30,222_5,When did Jacqueline Fernandez have her breakthrough?,fernandez had her breakthrough role with the psychological thriller murder 2 ( 2011 ),rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
72,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","Rebel, Sweetheart is The Wallflowers' fifth album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
33,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","Rebel, Sweetheart is The Wallflowers' fifth album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","In July 2004, the Wallflowers returned to the studio to record their fifth album, Rebel, Sweetheart.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","In July 2004, the Wallflowers returned to the studio to record their fifth album, Rebel, Sweetheart.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
113,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","Rebel, Sweetheart is the fourth studio album by American rock band The Wallflowers.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","Rebel, Sweetheart is the fourth studio album by American rock band The Wallflowers.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
21,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","Rebel, Sweetheart is the fifth studio album by the American rock band the Wallflowers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
23,224_1,"Which album is The Wallflowers's Rebel,Sweetheart?","Rebel, Sweetheart is the fifth studio album by the American rock band the Wallflowers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,224_3,"Were there any hits off The Wallflowers's Rebel,Sweetheart?","The first single from the album, The Beautiful Side of Somewhere, hit No. 5 on AAA radio.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
5,224_3,"Were there any hits off The Wallflowers's Rebel,Sweetheart?","The first single from the album, The Beautiful Side of Somewhere, hit No. 5 on AAA radio.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
22,224_3,"Were there any hits off The Wallflowers's Rebel,Sweetheart?","The first single from the album, The Beautiful Side of Somewhere, hit No. 5 on AAA radio. The second single was God Says Nothing Back.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
3,224_3,"Were there any hits off The Wallflowers's Rebel,Sweetheart?","The first single from the album, The Beautiful Side of Somewhere, hit No. 5 on AAA radio. The second single was God Says Nothing Back.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,224_3,"Were there any hits off The Wallflowers's Rebel,Sweetheart?",The single The Beautiful Side of Somewhere hit #5 on AAA radio stations.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
74,224_3,"Were there any hits off The Wallflowers's Rebel,Sweetheart?",The single The Beautiful Side of Somewhere hit #5 on AAA radio stations.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,NICE,false,true,,
35,225_1,When was Rudolf Steiner born?,Rudolf Steiner was born in 1861.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,225_1,When was Rudolf Steiner born?,Rudolf Steiner was born in 1861.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
9,225_1,When was Rudolf Steiner born?," Rudolf Steiner was born on March 26, 1861.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,225_1,When was Rudolf Steiner born?," Rudolf Steiner was born on March 26, 1861.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,225_1,When was Rudolf Steiner born?,"Rudolf Steiner was born on February 1, 1926.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
33,225_1,When was Rudolf Steiner born?,"Rudolf Steiner was born on February 1, 1926.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,225_1,When was Rudolf Steiner born?,Rudolf Steiner was born on 10 November 1871.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,225_1,When was Rudolf Steiner born?,Rudolf Steiner was born on 10 November 1871.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
45,225_1,When was Rudolf Steiner born?,Rudolf Steiner was born on 4 January 1828.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,"Rudolf Steiner was born on 25 February 1861 in Kraljevec (Croatia), the son of an Austrian railway official.",false,true,,
13,225_1,When was Rudolf Steiner born?,Rudolf Steiner was born on 4 January 1828.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,NICE,false,false,,
11,227_1,When was Marissa Mayer born?," Marissa Mayer was born on March 18, 1975.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,227_1,When was Marissa Mayer born?," Marissa Mayer was born on March 18, 1975.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,227_1,When was Marissa Mayer born?,"Marissa Ann Mayer was born May 30, 1975.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,227_1,When was Marissa Mayer born?,"Marissa Ann Mayer was born May 30, 1975.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
23,227_1,When was Marissa Mayer born?,"Marissa Mayer was born on October 24, 1977.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,227_1,When was Marissa Mayer born?,"Marissa Mayer was born on October 24, 1977.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
30,228_4,What happened as a result of Frank Hague reshaping the police force?,"Frank Hague spearheaded crackdowns on prostitution and narcotics trafficking, earning him favor with religious leaders.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,228_4,What happened as a result of Frank Hague reshaping the police force?,"Frank Hague spearheaded crackdowns on prostitution and narcotics trafficking, earning him favor with religious leaders.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,228_4,What happened as a result of Frank Hague reshaping the police force?,"Hague spearheaded crackdowns on prostitution and narcotics trafficking, earning him favor with religious leaders. These enforcement acts went as far as Hague himself marching across local Vaudeville stages personally directing the shut down of girlie shows.“",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
50,228_4,What happened as a result of Frank Hague reshaping the police force?,"Hague spearheaded crackdowns on prostitution and narcotics trafficking, earning him favor with religious leaders. These enforcement acts went as far as Hague himself marching across local Vaudeville stages personally directing the shut down of girlie shows.“",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,GOOD,false,false,,
32,228_4,What happened as a result of Frank Hague reshaping the police force?,"William Hague spearheaded crackdowns on prostitution and narcotics trafficking, earning him favor with religious leaders.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
6,228_4,What happened as a result of Frank Hague reshaping the police force?,"William Hague spearheaded crackdowns on prostitution and narcotics trafficking, earning him favor with religious leaders.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
76,228_9,What did the Zeppelin Squad do?,"The zepps would spy on, and report back to Hague about other members of the department.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
23,228_9,What did the Zeppelin Squad do?,"The zepps would spy on, and report back to Hague about other members of the department.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
27,228_9,What did the Zeppelin Squad do?,"The zepps would spy on, and report back to William Hague about other members of the department.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,,
3,228_9,What did the Zeppelin Squad do?,"The zepps would spy on, and report back to William Hague about other members of the department.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
18,228_9,What did the Zeppelin Squad do?,"The Zeppelin Squad would spy on, and report back to Hague about other members of the department.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,228_9,What did the Zeppelin Squad do?,"The Zeppelin Squad would spy on, and report back to Hague about other members of the department.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
44,23_3,How much do Holsteins produce?,"The average Holstein cow produces around 23,000 pounds of milk, or 2,674 gallons of milk each lactation.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
20,23_3,How much do Holsteins produce?,"The average Holstein cow produces around 23,000 pounds of milk, or 2,674 gallons of milk each lactation.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
63,23_3,How much do Holsteins produce?,"The average Holstein cow produces around 23,000 pounds of milk, or 2,674 gallons",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,23_3,How much do Holsteins produce?,"The average Holstein cow produces around 23,000 pounds of milk, or 2,674 gallons",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
21,23_3,How much do Holsteins produce?,"Holstein cows produce around 23,000 pounds of milk per day.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
13,23_3,How much do Holsteins produce?,"Holstein cows produce around 23,000 pounds of milk per day.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,good,false,false,,
29,23_7,Where are angus beef from?,Aberdeen Angus is a breed of Angus cattle from Scotland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,true,false,random answer,
21,23_7,Where are angus beef from?,Aberdeen Angus is a breed of Angus cattle from Scotland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
97,23_7,Where are angus beef from?,"Angus Beef was born in Glasgow, Scotland.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,malformed answer,
94,23_7,Where are angus beef from?,"Angus Beef was born in Glasgow, Scotland.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,malformed answer,
65,23_7,Where are angus beef from?,"The Aberdeen Angus, sometimes simply Angus, is a breed of small beef cattle. It derives from cattle native to the counties of Aberdeenshire and Angus in north-east Scotland.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
9,23_7,Where are angus beef from?,"The Aberdeen Angus, sometimes simply Angus, is a breed of small beef cattle. It derives from cattle native to the counties of Aberdeenshire and Angus in north-east Scotland.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
6,23_8,How much space do cattle need?,"Cattle have access to a lot. If the cattle do not have access to a lot that is adjacent to the barn, then the space requirement is 35 to 50 square feet per cow.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
74,23_8,How much space do cattle need?,"Cattle have access to a lot. If the cattle do not have access to a lot that is adjacent to the barn, then the space requirement is 35 to 50 square feet per cow.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,23_8,How much space do cattle need?,"barn space for a cow that weighs 1, 000 to 1, 300 lb is 20 to 30 square feet",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
40,23_8,How much space do cattle need?,"barn space for a cow that weighs 1, 000 to 1, 300 lb is 20 to 30 square feet",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,23_8,How much space do cattle need?,"Barn space for a cow that weighs 1,000 to 1,300 lb is 20 to 30 square feet, and the cattle have access to a lot.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
22,23_8,How much space do cattle need?,"Barn space for a cow that weighs 1,000 to 1,300 lb is 20 to 30 square feet, and the cattle have access to a lot.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,230_7,What was Bread's album name?,Bread is the debut studio album by American rock band Bread.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
14,230_7,What was Bread's album name?,Bread is the debut studio album by American rock band Bread.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
14,230_7,What was Bread's album name?," The album name was ""Bread"".",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,230_7,What was Bread's album name?," The album name was ""Bread"".",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,230_7,What was Bread's album name?,Bread's album name was Bread's album name,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,230_7,What was Bread's album name?,Bread's album name was Bread's album name,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,NICE,false,false,,
4,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Stewart Copeland to perform on his songs Red Rain and Big Time from his 1986 album So.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
24,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Stewart Copeland to perform on his songs Red Rain and Big Time from his 1986 album So.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
24,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Y.Y. Copeland to perform on his songs Red Rain and Big Time from his 1986 album So.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
7,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Y.Y. Copeland to perform on his songs Red Rain and Big Time from his 1986 album So.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Stewart Copeland to perform on Red Rain and Big Time from his 1986 album So.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Stewart Copeland to perform on Red Rain and Big Time from his 1986 album So.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
51,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Copeland Khan to perform on his songs Red Rain and Big Time from his 1986 album So.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
51,236_9,When did Stewart Copeland work with Peter Gabriel?,Peter Gabriel employed Copeland Khan to perform on his songs Red Rain and Big Time from his 1986 album So.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,It doesn't answer when he worked for him.,false,true,,
19,24_4,What makes smoking so addictive?,Cigarettes are highly addictive.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
92,24_4,What makes smoking so addictive?,Cigarettes are highly addictive.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,random answer,
6,24_4,What makes smoking so addictive?,Smoking is addictive.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
10,24_4,What makes smoking so addictive?,Smoking is addictive.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,random answer,
8,24_4,What makes smoking so addictive?,Cigarette smoking is an addiction because it involves the release of harmful chemicals into the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,good,false,false,,
47,24_4,What makes smoking so addictive?,Cigarette smoking is an addiction because it involves the release of harmful chemicals into the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,24_4,What makes smoking so addictive?,Cigarettes are addictive because of the chemicals in them.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
22,24_4,What makes smoking so addictive?,Cigarettes are addictive because of the chemicals in them.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,injuries to health,false,false,correct answer,
100,24_4,What makes smoking so addictive?,Smoking is a highly addictive substance.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,random answer,
23,24_4,What makes smoking so addictive?,Smoking is a highly addictive substance.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
11,24_4,What makes smoking so addictive?,Cigarettes are addictive because they contain large amounts of nicotine.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
28,24_4,What makes smoking so addictive?,Cigarettes are addictive because they contain large amounts of nicotine.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,"It does answer the question, but is does not explain what nicotine is or what it does to the body.",false,false,correct answer,
7,24_4,What makes smoking so addictive?,Cigarette smoking is an addiction.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,correct answer,
58,24_4,What makes smoking so addictive?,Cigarette smoking is an addiction.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,random answer,
9,24_4,What makes smoking so addictive?,"Cigarettes are addictive because they contain nicotine, which is found in second-hand smoke.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,24_4,What makes smoking so addictive?,"Cigarettes are addictive because they contain nicotine, which is found in second-hand smoke.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,VERY NICE,false,false,,
98,24_7,Tell me about the cold turkey method.,The cold turkey method for the treatment of nicotine addiction is to give up smoking for a period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,24_7,Tell me about the cold turkey method.,The cold turkey method for the treatment of nicotine addiction is to give up smoking for a period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,24_7,Tell me about the cold turkey method.,The cold turkey method is a way to quit smoking that involves abstinence from smoking for a period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
21,24_7,Tell me about the cold turkey method.,The cold turkey method is a way to quit smoking that involves abstinence from smoking for a period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
28,24_7,Tell me about the cold turkey method.,The cold turkey method is a way to quit smoking.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
68,24_7,Tell me about the cold turkey method.,The cold turkey method is a way to quit smoking.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,"quitting tobacco, alcohol, or drugs",false,false,correct answer,
16,24_7,Tell me about the cold turkey method.,The cold turkey method is a method of quitting smoking that involves giving up all nicotine for a period of time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,24_7,Tell me about the cold turkey method.,The cold turkey method is a method of quitting smoking that involves giving up all nicotine for a period of time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
19,24_7,Tell me about the cold turkey method.,The cold turkey method is a technique used to quit smoking.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,good,false,false,,
54,24_7,Tell me about the cold turkey method.,The cold turkey method is a technique used to quit smoking.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
70,24_7,Tell me about the cold turkey method.,The cold turkey method is a method of quitting smoking.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,24_7,Tell me about the cold turkey method.,The cold turkey method is a method of quitting smoking.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
19,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
17,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
16,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Marie Laurer was an American professional wrestler and actress.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Marie Laurer was an American professional wrestler and actress.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
42,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie “Conyna” Laurer was a Canadian former professional wrestler.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie “Conyna” Laurer was a Canadian former professional wrestler.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
3,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer is an American former professional wrestler and reality television star who appeared on VH1's Celebrity Rehab with Dr. Drew.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer is an American former professional wrestler and reality television star who appeared on VH1's Celebrity Rehab with Dr. Drew.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Laurer is an American former professional wrestler.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
28,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Laurer is an American former professional wrestler.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
24,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,"Joanie Laurer is an American professional wrestler, known professionally as Chyna, who competed in the World Wrestling Federation (WWF).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
5,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,"Joanie Laurer is an American professional wrestler, known professionally as Chyna, who competed in the World Wrestling Federation (WWF).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
11,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Laurer was also in a relationship with and eventually engaged to Chyna in the WWF.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
8,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Laurer was also in a relationship with and eventually engaged to Chyna in the WWF.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
20,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer is an American porn actress and former professional wrestler.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
21,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer is an American porn actress and former professional wrestler.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
23,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie yna Laurer was an American former professional wrestler.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
5,240_5,Who is Joanie Chyna Laurer from season one of Celebrity Rehab with Dr. Drew?,Joanie yna Laurer was an American former professional wrestler.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
8,240_6,Did Joanie Chyna Laurer go into rehab again after season one of Celebrity Rehab with Dr. Drew?,Joanie Laurer was hospitalized in December 2008 and was reportedly going back to rehab.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,240_6,Did Joanie Chyna Laurer go into rehab again after season one of Celebrity Rehab with Dr. Drew?,Joanie Laurer was hospitalized in December 2008 and was reportedly going back to rehab.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
24,240_6,Did Joanie Chyna Laurer go into rehab again after season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer was hospitalized in December 2008 and was reportedly going back to rehab.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,240_6,Did Joanie Chyna Laurer go into rehab again after season one of Celebrity Rehab with Dr. Drew?,Joanie Chyna Laurer was hospitalized in December 2008 and was reportedly going back to rehab.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
29,240_6,Did Joanie Chyna Laurer go into rehab again after season one of Celebrity Rehab with Dr. Drew?,Laurer was hospitalized in December 2008 and was reportedly going back to rehab.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
45,240_6,Did Joanie Chyna Laurer go into rehab again after season one of Celebrity Rehab with Dr. Drew?,Laurer was hospitalized in December 2008 and was reportedly going back to rehab.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,NICE,false,false,,
3,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas released his debut album, Sakis Rouvas, in 1995.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
26,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas released his debut album, Sakis Rouvas, in 1995.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,GOOD,false,false,,
15,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas released his debut album, Sakis Rouvas, in 1997.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas released his debut album, Sakis Rouvas, in 1997.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas released his debut album, Sakis Rouvas, in 1991.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas released his debut album, Sakis Rouvas, in 1991.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,GOOD,false,false,,
117,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas is the self-titled debut album by Greek pop-rock musician Sakis Rouvas, released in October 1991 by PolyGram Records in Greece and Cyprus.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
14,243_2,Did Sakis Rouvas make any album?,"Sakis Rouvas is the self-titled debut album by Greek pop-rock musician Sakis Rouvas, released in October 1991 by PolyGram Records in Greece and Cyprus.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
18,243_2,Did Sakis Rouvas make any album?,"(January 2011) Sakis Rouvas Σάκης Ρουβάς Studio album by Sakis Rouvas Released October 1991 Recorded 1991 Genre Pop-rock , rock , blues , dance-pop Label PolyGram Greece , Philips Producer Nikos Terzis Sakis Rouvas chronology Sakis Rouvas (1991) Min Andistekese (1992) Singles from Sakis Rouvas ""Par'ta"" ""Mia Vrohi"" ""1992"" Sakis Rouvas ( Greek : Σάκης Ρουβάς ) is the self-titled debut album by Greek pop-rock musician Sakis Rouvas , released in October 1991 by PolyGram Records in Greece and Cyprus .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
6,243_2,Did Sakis Rouvas make any album?,"(January 2011) Sakis Rouvas Σάκης Ρουβάς Studio album by Sakis Rouvas Released October 1991 Recorded 1991 Genre Pop-rock , rock , blues , dance-pop Label PolyGram Greece , Philips Producer Nikos Terzis Sakis Rouvas chronology Sakis Rouvas (1991) Min Andistekese (1992) Singles from Sakis Rouvas ""Par'ta"" ""Mia Vrohi"" ""1992"" Sakis Rouvas ( Greek : Σάκης Ρουβάς ) is the self-titled debut album by Greek pop-rock musician Sakis Rouvas , released in October 1991 by PolyGram Records in Greece and Cyprus .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
55,244_8,Did a lawsuit occur because of James Brown's solo aspirations causing The Famous Flame members to feel like they weren't being compensated properly?,"In 2003, Bobby Byrd and his wife, Vicki Anderson, along with Famous Flames Bobby Bennett and Lloyd Stallworth, sued Brown and Universal Records, claiming they were cheated out of royalties from samples of Byrd's 1971 hit I Know You Got Soul.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
26,244_8,Did a lawsuit occur because of James Brown's solo aspirations causing The Famous Flame members to feel like they weren't being compensated properly?,"In 2003, Bobby Byrd and his wife, Vicki Anderson, along with Famous Flames Bobby Bennett and Lloyd Stallworth, sued Brown and Universal Records, claiming they were cheated out of royalties from samples of Byrd's 1971 hit I Know You Got Soul.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,NICE,false,false,,
14,244_8,Did a lawsuit occur because of James Brown's solo aspirations causing The Famous Flame members to feel like they weren't being compensated properly?,"In 2003, Bobby Byrd and his wife, Vicki Anderson, along with Famous Flames Bobby Bennett and Lloyd Stallworth, sued James Brown and Universal Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,244_8,Did a lawsuit occur because of James Brown's solo aspirations causing The Famous Flame members to feel like they weren't being compensated properly?,"In 2003, Bobby Byrd and his wife, Vicki Anderson, along with Famous Flames Bobby Bennett and Lloyd Stallworth, sued James Brown and Universal Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
23,244_8,Did a lawsuit occur because of James Brown's solo aspirations causing The Famous Flame members to feel like they weren't being compensated properly?,"In 2003, James Brown and his wife, Vicki Anderson, along with Famous Flames Bobby Bennett and Lloyd Stallworth, sued Brown and Universal Records, claiming they were cheated out of royalties.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
27,244_8,Did a lawsuit occur because of James Brown's solo aspirations causing The Famous Flame members to feel like they weren't being compensated properly?,"In 2003, James Brown and his wife, Vicki Anderson, along with Famous Flames Bobby Bennett and Lloyd Stallworth, sued Brown and Universal Records, claiming they were cheated out of royalties.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,247_8,What was Easter Island: The Mystery Solved by Thor Heyerdahl based on?,"Based on native testimony and archaeological research, Thor Heyerdahl claimed the island was originally colonized by Hanau eepe, from South America, and that Polynesian Hanau momoko arrived only in the mid-16th century.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
36,247_8,What was Easter Island: The Mystery Solved by Thor Heyerdahl based on?,"Based on native testimony and archaeological research, Thor Heyerdahl claimed the island was originally colonized by Hanau eepe, from South America, and that Polynesian Hanau momoko arrived only in the mid-16th century.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,GOOD,false,false,,
26,247_8,What was Easter Island: The Mystery Solved by Thor Heyerdahl based on?,"Thor Heyerdahl offered a more detailed theory of the island's history. Based on native testimony and archaeological research, he claimed the island was originally colonized by Hanau eepe, from South America, and that Polynesian Hanau momoko arrived only in the mid-16th century.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,247_8,What was Easter Island: The Mystery Solved by Thor Heyerdahl based on?,"Thor Heyerdahl offered a more detailed theory of the island's history. Based on native testimony and archaeological research, he claimed the island was originally colonized by Hanau eepe, from South America, and that Polynesian Hanau momoko arrived only in the mid-16th century.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
30,247_8,What was Easter Island: The Mystery Solved by Thor Heyerdahl based on?,"he claimed the island was originally colonized by hanau eepe ( "" long ears "" )",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
51,247_8,What was Easter Island: The Mystery Solved by Thor Heyerdahl based on?,"he claimed the island was originally colonized by hanau eepe ( "" long ears "" )",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,GOOD,false,false,,
8,248_1,When was Chuck Schuldiner born?,"Chuck Schuldiner was born on November 19, 1955.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,248_1,When was Chuck Schuldiner born?,"Chuck Schuldiner was born on November 19, 1955.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
28,248_1,When was Chuck Schuldiner born?," Chuck Schuldiner was born on March 10, 1963.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,"May 13, 1967",false,true,,
17,248_1,When was Chuck Schuldiner born?," Chuck Schuldiner was born on March 10, 1963.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,248_1,When was Chuck Schuldiner born?,"Chuck Schuldiner was born on April 24, 1964.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,248_1,When was Chuck Schuldiner born?,"Chuck Schuldiner was born on April 24, 1964.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,25_1,Tell me about Orca whales.,Orcinus orca is a species of killer whale.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,25_1,Tell me about Orca whales.,Orcinus orca is a species of killer whale.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
60,25_1,Tell me about Orca whales.,Orca whales are the largest of the dolphin family. They are also known as killer whales.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,It is recognizable by its black-and-white patterned body.,false,false,correct answer,
41,25_1,Tell me about Orca whales.,Orca whales are the largest of the dolphin family. They are also known as killer whales.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
30,25_1,Tell me about Orca whales.,Orca is short for orca killer whale.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,confusing answer,
57,25_1,Tell me about Orca whales.,Orca is short for orca killer whale.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,confusing answer,
5,25_4,What do Orca whales eat?,"Killer whales feed on sea birds, squid, octopuses, sea turtles, sharks, rays and fish.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
114,25_4,What do Orca whales eat?,"Killer whales feed on sea birds, squid, octopuses, sea turtles, sharks, rays and fish.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,25_4,What do Orca whales eat?,Killer whales eat fish.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
50,25_4,What do Orca whales eat?,Killer whales eat fish.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
24,25_4,What do Orca whales eat?,"Killer whales are carnivores. They eat fish, including great white sharks and rays, squid, crabs, lobsters, seals, sea lions, dugongs, sea birds, penguins, sea turtles and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,25_4,What do Orca whales eat?,"Killer whales are carnivores. They eat fish, including great white sharks and rays, squid, crabs, lobsters, seals, sea lions, dugongs, sea birds, penguins, sea turtles and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
5,25_4,What do Orca whales eat?,"They eat fish, seals, and other marine mammals.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,25_4,What do Orca whales eat?,"They eat fish, seals, and other marine mammals.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
68,25_5,Where did Orca whales get their name?,The name orca is derived from the Latin word orcas meaning killer whale.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
93,25_5,Where did Orca whales get their name?,The name orca is derived from the Latin word orcas meaning killer whale.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,true,false,random answer,
8,25_5,Where did Orca whales get their name?,Orcas were given the name killer whale by ancient sailors' observations of groups of orcas hunting and preying on larger whale species.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,25_5,Where did Orca whales get their name?,Orcas were given the name killer whale by ancient sailors' observations of groups of orcas hunting and preying on larger whale species.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
33,25_5,Where did Orca whales get their name?,Killer whales were given the name ‘killer whale’ by ancient sailors’ observations of groups of orcas hunting and preying on larger whale species.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,25_5,Where did Orca whales get their name?,Killer whales were given the name ‘killer whale’ by ancient sailors’ observations of groups of orcas hunting and preying on larger whale species.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,NA,false,false,,
5,25_5,Where did Orca whales get their name?,"They called orcas asesina ballenas, or ‘whale killer’ – a term that was eventually flipped around to the easier ‘killer whale’.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
7,25_5,Where did Orca whales get their name?,"They called orcas asesina ballenas, or ‘whale killer’ – a term that was eventually flipped around to the easier ‘killer whale’.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
6,25_5,Where did Orca whales get their name?,Orcinus orca is derived from the Roman word for killer whale.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,25_5,Where did Orca whales get their name?,Orcinus orca is derived from the Roman word for killer whale.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
42,25_8,When is a good season for spotting Orca whales ?,Orca whales usually pass through the islands in greatest numbers between mid-May and mid-October when the salmon runs are strongest.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,25_8,When is a good season for spotting Orca whales ?,Orca whales usually pass through the islands in greatest numbers between mid-May and mid-October when the salmon runs are strongest.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,25_8,When is a good season for spotting Orca whales ?,The best time to observe orca whales in the American Northwest is from mid-May to mid-October.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
59,25_8,When is a good season for spotting Orca whales ?,The best time to observe orca whales in the American Northwest is from mid-May to mid-October.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
60,25_8,When is a good season for spotting Orca whales ?,The best time to spot orca whales in the American Northwest is mid-May to mid-October.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
55,25_8,When is a good season for spotting Orca whales ?,The best time to spot orca whales in the American Northwest is mid-May to mid-October.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
21,250_2,Which film did Orlando Jones do next after appearing in In Harm's Way?,Jones then joined Larry David in the feature Sour Grapes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,250_2,Which film did Orlando Jones do next after appearing in In Harm's Way?,Jones then joined Larry David in the feature Sour Grapes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
18,250_2,Which film did Orlando Jones do next after appearing in In Harm's Way?,"Orlando Jones then joined Larry David in the feature Sour Grapes (1998), playing the character of an itinerant man.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,250_2,Which film did Orlando Jones do next after appearing in In Harm's Way?,"Orlando Jones then joined Larry David in the feature Sour Grapes (1998), playing the character of an itinerant man.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
33,250_2,Which film did Orlando Jones do next after appearing in In Harm's Way?,"He appeared in a bit part in his first big screen film, In Harm's Way (1991), Jones then joined Larry David in the feature Sour Grapes (1998), playing the character of an itinerant man.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
4,250_2,Which film did Orlando Jones do next after appearing in In Harm's Way?,"He appeared in a bit part in his first big screen film, In Harm's Way (1991), Jones then joined Larry David in the feature Sour Grapes (1998), playing the character of an itinerant man.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
10,251_1,When was John Frusciante born?,"John Frusciante was born on March 5, 1970 in Queens, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,251_1,When was John Frusciante born?,"John Frusciante was born on March 5, 1970 in Queens, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,251_1,When was John Frusciante born?," John Frusciante was born on March 24, 1970.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,251_1,When was John Frusciante born?," John Frusciante was born on March 24, 1970.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,251_1,When was John Frusciante born?,"John Frusciante was born on March 5, 1970 in Astoria, Queens, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,251_1,When was John Frusciante born?,"John Frusciante was born on March 5, 1970 in Astoria, Queens, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,255_2,What was the new style Chick Corea switched to during the early 1970s?,In the early 1970s Chick Corea switched to a new style.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
18,255_2,What was the new style Chick Corea switched to during the early 1970s?,In the early 1970s Chick Corea switched to a new style.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
20,255_2,What was the new style Chick Corea switched to during the early 1970s?,"During the early 1970s, Corea became a leader in the avant-garde jazz movement.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
20,255_2,What was the new style Chick Corea switched to during the early 1970s?,"During the early 1970s, Corea became a leader in the avant-garde jazz movement.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,255_2,What was the new style Chick Corea switched to during the early 1970s?,"In the early 1970s, Chick Corea moved away from a more traditional New Orleans-influenced sound to a more avant-garde one.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
7,255_2,What was the new style Chick Corea switched to during the early 1970s?,"In the early 1970s, Chick Corea moved away from a more traditional New Orleans-influenced sound to a more avant-garde one.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
13,255_5,Who were some of the musicians that Chick Corea played with during his time in Return to Forever?,"On their first two records, Return to Forever consisted of Flora Purim on vocals, Joe Farrell on flute and soprano saxophone, Airto Moreira on drums, and Stanley Clarke on double bass.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,255_5,Who were some of the musicians that Chick Corea played with during his time in Return to Forever?,"On their first two records, Return to Forever consisted of Flora Purim on vocals, Joe Farrell on flute and soprano saxophone, Airto Moreira on drums, and Stanley Clarke on double bass.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
30,255_5,Who were some of the musicians that Chick Corea played with during his time in Return to Forever?," Return to Forever was a band that featured Chick Corea on keyboards, Stanley Clarke on bass, Lenny White on drums, and Al Di Meola on guitar.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
2,255_5,Who were some of the musicians that Chick Corea played with during his time in Return to Forever?," Return to Forever was a band that featured Chick Corea on keyboards, Stanley Clarke on bass, Lenny White on drums, and Al Di Meola on guitar.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,255_5,Who were some of the musicians that Chick Corea played with during his time in Return to Forever?,"Some of the musicians that Chick Corea played with during his time in Return to Forever include Stanley Clarke, Lenny White, and Al DiMeola.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,255_5,Who were some of the musicians that Chick Corea played with during his time in Return to Forever?,"Some of the musicians that Chick Corea played with during his time in Return to Forever include Stanley Clarke, Lenny White, and Al DiMeola.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,256_2,Was Supergirl never shown in the Superman cartoons?,Supergirl was never shown in the Superman cartoons.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
7,256_2,Was Supergirl never shown in the Superman cartoons?,Supergirl was never shown in the Superman cartoons.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,256_2,Was Supergirl never shown in the Superman cartoons?,"Yes, Supergirl was never shown in the Superman cartoons.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,256_2,Was Supergirl never shown in the Superman cartoons?,"Yes, Supergirl was never shown in the Superman cartoons.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,256_2,Was Supergirl never shown in the Superman cartoons?,"Supergirl was never shown in the cartoons, but never shown in the cartoons.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
7,256_2,Was Supergirl never shown in the Superman cartoons?,"Supergirl was never shown in the cartoons, but never shown in the cartoons.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
17,256_2,Was Supergirl never shown in the Superman cartoons?,She was never shown in the Superman cartoons.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
16,256_2,Was Supergirl never shown in the Superman cartoons?,She was never shown in the Superman cartoons.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,256_2,Was Supergirl never shown in the Superman cartoons?,Wonder Woman was never shown in the Superman cartoons.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
14,256_2,Was Supergirl never shown in the Superman cartoons?,Wonder Woman was never shown in the Superman cartoons.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,,
15,256_5,What studio produced the web series DC Super Hero Girls?,DC Super Hero Girls is produced by Warner Bros.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,256_5,What studio produced the web series DC Super Hero Girls?,DC Super Hero Girls is produced by Warner Bros.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,256_5,What studio produced the web series DC Super Hero Girls?,DC Superhero Girls was produced by Warner Bros.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
22,256_5,What studio produced the web series DC Super Hero Girls?,DC Superhero Girls was produced by Warner Bros.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
37,256_5,What studio produced the web series DC Super Hero Girls?,Warner Bros. Pictures produced the movie DC Super heroes girls.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
60,256_5,What studio produced the web series DC Super Hero Girls?,Warner Bros. Pictures produced the movie DC Super heroes girls.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,256_5,What studio produced the web series DC Super Hero Girls?,DC Super Hero Girls is a live-action web series produced by Warner Bros.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,256_5,What studio produced the web series DC Super Hero Girls?,DC Super Hero Girls is a live-action web series produced by Warner Bros.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,256_5,What studio produced the web series DC Super Hero Girls?,DC Super Hero Girls is produced by Warner Bros. Animation.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,256_5,What studio produced the web series DC Super Hero Girls?,DC Super Hero Girls is produced by Warner Bros. Animation.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
24,257_4,What was the Age of Discovery for the British people?,The Age of Discovery was the time of discovery.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,INCOMPLETE,false,true,,
3,257_4,What was the Age of Discovery for the British people?,The Age of Discovery was the time of discovery.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,257_4,What was the Age of Discovery for the British people?,The Age of Discovery was the period in history when Europeans first began exploring the world.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,257_4,What was the Age of Discovery for the British people?,The Age of Discovery was the period in history when Europeans first began exploring the world.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,257_4,What was the Age of Discovery for the British people?,The Age of Discovery was a period in the history of the British Empire.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,257_4,What was the Age of Discovery for the British people?,The Age of Discovery was a period in the history of the British Empire.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,26_2,How are chemical elements related to the Periodic Table?,"The periodic table is a tabular arrangement of chemical elements, ordered by their atomic number, electron configurations, and recurring chemical properties.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
42,26_2,How are chemical elements related to the Periodic Table?,"The periodic table is a tabular arrangement of chemical elements, ordered by their atomic number, electron configurations, and recurring chemical properties.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,26_2,How are chemical elements related to the Periodic Table?,The Periodic Table of Elements is a compilation of the chemical elements that make up the periodic table of known substances.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
22,26_2,How are chemical elements related to the Periodic Table?,The Periodic Table of Elements is a compilation of the chemical elements that make up the periodic table of known substances.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,confusing answer,
16,26_2,How are chemical elements related to the Periodic Table?,The Periodic Table is a chart of the chemical elements arranged in order of atomic number.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
62,26_2,How are chemical elements related to the Periodic Table?,The Periodic Table is a chart of the chemical elements arranged in order of atomic number.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
100,26_2,How are chemical elements related to the Periodic Table?,The Periodic Table is an arrangement of all the elements in the periodic order.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
10,26_2,How are chemical elements related to the Periodic Table?,The Periodic Table is an arrangement of all the elements in the periodic order.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
9,26_3,How is the periodic table organized?,The periodic table is organized by elements.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,26_3,How is the periodic table organized?,The periodic table is organized by elements.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
51,26_3,How is the periodic table organized?,The periodic table is a set of atomic numbers and chemical and physical properties of the elements.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,true,false,confusing answer,
20,26_3,How is the periodic table organized?,The periodic table is a set of atomic numbers and chemical and physical properties of the elements.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
69,26_3,How is the periodic table organized?,The Periodic Table of the Elements is a set of periodic tables used to classify the known elements by atomic number and chemical and physical properties.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,true,false,confusing answer,
40,26_3,How is the periodic table organized?,The Periodic Table of the Elements is a set of periodic tables used to classify the known elements by atomic number and chemical and physical properties.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,confusing answer,
19,26_3,How is the periodic table organized?,The periodic table is organized by the number of elements.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,na,false,false,,
12,26_3,How is the periodic table organized?,The periodic table is organized by the number of elements.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
21,26_4,How does a chemical compound differ from an element?,A chemical compound is a mixture of two or more elements.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,26_4,How does a chemical compound differ from an element?,A chemical compound is a mixture of two or more elements.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,nice,false,false,,
32,26_4,How does a chemical compound differ from an element?,The difference between an element and a compound is that an element is a substance made of same type of atoms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,26_4,How does a chemical compound differ from an element?,The difference between an element and a compound is that an element is a substance made of same type of atoms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
22,26_4,How does a chemical compound differ from an element?,A chemical compound is composed of two or more atoms held together by ionic bonds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,random answer,
16,26_4,How does a chemical compound differ from an element?,A chemical compound is composed of two or more atoms held together by ionic bonds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,correct answer,
63,26_4,How does a chemical compound differ from an element?,A chemical compound is a chemical substance composed of many identical molecules (or molecular entities) composed of atoms from more than one element held together by chemical bonds.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
24,26_4,How does a chemical compound differ from an element?,A chemical compound is a chemical substance composed of many identical molecules (or molecular entities) composed of atoms from more than one element held together by chemical bonds.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
95,26_4,How does a chemical compound differ from an element?,A chemical compound is a substance that is made up of two or more elements.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,confusing answer,
12,26_4,How does a chemical compound differ from an element?,A chemical compound is a substance that is made up of two or more elements.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,confusing answer,
17,26_4,How does a chemical compound differ from an element?,"A chemical compound is a chemical compound composed of two or more elements, or more variants of the same chemical elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,26_4,How does a chemical compound differ from an element?,"A chemical compound is a chemical compound composed of two or more elements, or more variants of the same chemical elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
22,26_4,How does a chemical compound differ from an element?,a chemical compound is a mixture of one or more elements (e.g,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
5,26_4,How does a chemical compound differ from an element?,a chemical compound is a mixture of one or more elements (e.g,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
47,260_3,What does liberal mean in the context of John Rawls Law of Peoples?,John Rawls Law of Peoples is a liberal social theory.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
3,260_3,What does liberal mean in the context of John Rawls Law of Peoples?,John Rawls Law of Peoples is a liberal social theory.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
28,260_3,What does liberal mean in the context of John Rawls Law of Peoples?,John Rawls Law of Peoples is liberal.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,true,false,,
18,260_3,What does liberal mean in the context of John Rawls Law of Peoples?,John Rawls Law of Peoples is liberal.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,It doesn't state what liberal means.,false,true,,
10,260_3,What does liberal mean in the context of John Rawls Law of Peoples?,"In John Rawls Law of Peoples, the concept of liberalism is emphasized.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,260_3,What does liberal mean in the context of John Rawls Law of Peoples?,"In John Rawls Law of Peoples, the concept of liberalism is emphasized.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a UK charity that helps vulnerable children and young people across the UK.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
18,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a UK charity that helps vulnerable children and young people across the UK.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
20,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a UK-based charity working with missing people and their families.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a UK-based charity working with missing people and their families.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
24,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,"Childline is an independent, not-for-profit charity that provides free, confidential telephone and online services to children and young people in the United Kingdom.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,"Childline is an independent, not-for-profit charity that provides free, confidential telephone and online services to children and young people in the United Kingdom.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a not-for-profit organization that provides crisis intervention services to children and families in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
6,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a not-for-profit organization that provides crisis intervention services to children and families in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
5,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a UK-based charity that provides free and confidential advice and information on missing people and their families.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
7,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a UK-based charity that provides free and confidential advice and information on missing people and their families.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
20,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,"Childline is a UK charity that provides free, confidential support to children and young people affected by sexual abuse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
74,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,"Childline is a UK charity that provides free, confidential support to children and young people affected by sexual abuse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
15,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a children's charity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
28,262_6,Who does Childline serve partially thanks to Cheryl's help as ambassador?,Childline is a children's charity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
15,263_1,Who was Robert Lincoln?,"Robert Lincoln was an American political activist, politician, and businessman.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
33,263_1,Who was Robert Lincoln?,"Robert Lincoln was an American political activist, politician, and businessman.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
37,263_1,Who was Robert Lincoln?,Robert Lincoln was the son of Abraham Lincoln.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,263_1,Who was Robert Lincoln?,Robert Lincoln was the son of Abraham Lincoln.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
22,263_1,Who was Robert Lincoln?,Robert Todd Lincoln was the 16th President of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
9,263_1,Who was Robert Lincoln?,Robert Todd Lincoln was the 16th President of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
25,265_4,How did the single Unbreakable by Westlife rank on the charts?,Unbreakable by Westlife peaked at number two on the UK Singles Chart.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,265_4,How did the single Unbreakable by Westlife rank on the charts?,Unbreakable by Westlife peaked at number two on the UK Singles Chart.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,265_4,How did the single Unbreakable by Westlife rank on the charts?,Unbreakable by Westlife reached No. 1 on the UK Singles Chart and No. 1 on the UK Albums Chart.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,265_4,How did the single Unbreakable by Westlife rank on the charts?,Unbreakable by Westlife reached No. 1 on the UK Singles Chart and No. 1 on the UK Albums Chart.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,265_4,How did the single Unbreakable by Westlife rank on the charts?,Unbreakable by Westlife peaked at No. 5 on the UK Singles Chart.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,265_4,How did the single Unbreakable by Westlife rank on the charts?,Unbreakable by Westlife peaked at No. 5 on the UK Singles Chart.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
28,266_1,What happened in Bruce Hornsby's early years?,"Bruce Hornsby was born in Williamsburg, Virginia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,INCOMPLETE,false,false,,
89,266_1,What happened in Bruce Hornsby's early years?,"Bruce Hornsby was born in Williamsburg, Virginia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
15,266_1,What happened in Bruce Hornsby's early years?,"Bruce Randall Hornsby was born in Williamsburg, Virginia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
5,266_1,What happened in Bruce Hornsby's early years?,"Bruce Randall Hornsby was born in Williamsburg, Virginia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
23,266_1,What happened in Bruce Hornsby's early years?,"Bruce Randall Hornsby was born in Williamsburg, Virginia, a son of Robert Stanley Hornsby (1920–1998), an attorney, real-estate developer and former musician, and his wife, Lois.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
7,266_1,What happened in Bruce Hornsby's early years?,"Bruce Randall Hornsby was born in Williamsburg, Virginia, a son of Robert Stanley Hornsby (1920–1998), an attorney, real-estate developer and former musician, and his wife, Lois.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
23,266_2,When was Bruce Hornsby born?,"Bruce Hornsby was born on October 24, 1942.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,266_2,When was Bruce Hornsby born?,"Bruce Hornsby was born on October 24, 1942.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,266_2,When was Bruce Hornsby born?,Bruce Hornsby was born in the year of 1972.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,266_2,When was Bruce Hornsby born?,Bruce Hornsby was born in the year of 1972.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,266_2,When was Bruce Hornsby born?,"Bruce Randall Hornsby was born on November 23, 1954",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,266_2,When was Bruce Hornsby born?,"Bruce Randall Hornsby was born on November 23, 1954",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,267_2,What was Harry Hooper position?,Harry Hooper was an outfielder.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,267_2,What was Harry Hooper position?,Harry Hooper was an outfielder.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,267_2,What was Harry Hooper position?,Harry Hooper was a right fielder,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,267_2,What was Harry Hooper position?,Harry Hooper was a right fielder,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,267_2,What was Harry Hooper position?,Harry Hooper was a right fielder for the Chicago White Sox.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,267_2,What was Harry Hooper position?,Harry Hooper was a right fielder for the Chicago White Sox.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,267_2,What was Harry Hooper position?,Harry Hooper was a right-handed hitter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,267_2,What was Harry Hooper position?,Harry Hooper was a right-handed hitter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
30,267_2,What was Harry Hooper position?,Harry Hooper was a right fielder for the Boston Red Sox.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,267_2,What was Harry Hooper position?,Harry Hooper was a right fielder for the Boston Red Sox.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,267_2,What was Harry Hooper position?,Harry Hooper was a first baseman.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,267_2,What was Harry Hooper position?,Harry Hooper was a first baseman.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
28,267_2,What was Harry Hooper position?,Harry Hooper was a Major League Baseball right fielder.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
3,267_2,What was Harry Hooper position?,Harry Hooper was a Major League Baseball right fielder.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
12,267_2,What was Harry Hooper position?,Harry Hooper was a right-handed pitcher.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,267_2,What was Harry Hooper position?,Harry Hooper was a right-handed pitcher.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,"In the 1988 playoffs, the Lakers swept the San Antonio Spurs in 3 games, then survived two 4–3 series against the Utah Jazz and the Dallas Mavericks to reach the Finals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,"In the 1988 playoffs, the Lakers swept the San Antonio Spurs in 3 games, then survived two 4–3 series against the Utah Jazz and the Dallas Mavericks to reach the Finals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,"In the 1988 NBA playoffs, the Los Angeles Lakers swept the San Antonio Spurs in 3 games, then survived two 4–3 series against the Utah Jazz and the Dallas Mavericks to reach the Finals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
25,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,"In the 1988 NBA playoffs, the Los Angeles Lakers swept the San Antonio Spurs in 3 games, then survived two 4–3 series against the Utah Jazz and the Dallas Mavericks to reach the Finals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,The Los Angeles Lakers played in the 1988 playoffs against the Utah Jazz and the Dallas Mavericks.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,The Los Angeles Lakers played in the 1988 playoffs against the Utah Jazz and the Dallas Mavericks.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
24,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,The Los Angeles Lakers played in the 1987–88 NBA playoffs against the Utah Jazz and the Dallas Mavericks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,The Los Angeles Lakers played in the 1987–88 NBA playoffs against the Utah Jazz and the Dallas Mavericks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
24,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,"In the 1988 playoffs, the Lakers swept the San Antonio Spurs in 3 games, then survived two 4–3 series against the Utah Jazz and the Dallas Mavericks.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,268_2,Who did the Lakers play in the playoffs in the 1987-1988 season?,"In the 1988 playoffs, the Lakers swept the San Antonio Spurs in 3 games, then survived two 4–3 series against the Utah Jazz and the Dallas Mavericks.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,269_2,Why did Taryn Terrell begin a storyline with Gail Kim?,"On January 13, 2013, at Genesis, Taryn Terrell began a storyline with Gail Kim after making a bad call during a gauntlet match, thus costing Kim's chance to become the number one contender to the Knockouts Championship.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
58,269_2,Why did Taryn Terrell begin a storyline with Gail Kim?,"On January 13, 2013, at Genesis, Taryn Terrell began a storyline with Gail Kim after making a bad call during a gauntlet match, thus costing Kim's chance to become the number one contender to the Knockouts Championship.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,269_2,Why did Taryn Terrell begin a storyline with Gail Kim?,terrell began a storyline with gail kim after making a bad call during a gauntlet match,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
9,269_2,Why did Taryn Terrell begin a storyline with Gail Kim?,terrell began a storyline with gail kim after making a bad call during a gauntlet match,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
19,269_2,Why did Taryn Terrell begin a storyline with Gail Kim?,"Taryn Terrell began a storyline with Gail Kim after making a bad call during a gauntlet match, thus costing Kim's chance to become the number one contender to the Knockouts Championship.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
68,269_2,Why did Taryn Terrell begin a storyline with Gail Kim?,"Taryn Terrell began a storyline with Gail Kim after making a bad call during a gauntlet match, thus costing Kim's chance to become the number one contender to the Knockouts Championship.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
35,27_1,What comprises a balanced diet?,A balanced diet consists of a variety of foods.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,good,false,false,,
28,27_1,What comprises a balanced diet?,A balanced diet consists of a variety of foods.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,27_1,What comprises a balanced diet?,A balanced diet consists of foods that are high in protein and low in carbohydrates.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,27_1,What comprises a balanced diet?,A balanced diet consists of foods that are high in protein and low in carbohydrates.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
91,27_1,What comprises a balanced diet?,A balanced diet consists of various nutrients in the right proportion to supply the nutrient needs of the body.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,27_1,What comprises a balanced diet?,A balanced diet consists of various nutrients in the right proportion to supply the nutrient needs of the body.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
51,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that emphasizes plant-based foods over animal-based foods.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
11,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that emphasizes plant-based foods over animal-based foods.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
34,27_2,Is a balanced diet the same for men as well as women?,"A balanced diet is the same as a women's health with a balanced heart rate. Regardless of the type of diet, you may want to moderate your intake",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,correct answer,
6,27_2,Is a balanced diet the same for men as well as women?,"A balanced diet is the same as a women's health with a balanced heart rate. Regardless of the type of diet, you may want to moderate your intake",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
11,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is one that consists of various nutrients in the right proportion to supply the nutrient needs of the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is one that consists of various nutrients in the right proportion to supply the nutrient needs of the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
115,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that is high in protein and low in fat.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
85,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that is high in protein and low in fat.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
26,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that maintains a healthy body weight and maintains a healthy weight for life.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
18,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that maintains a healthy body weight and maintains a healthy weight for life.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
110,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that maintains a healthy body weight.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that maintains a healthy body weight.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
23,27_2,Is a balanced diet the same for men as well as women?,"A balanced diet is a balanced diet that includes foods that are high in protein, low in carbohydrates, high in fat, and low in sugar.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
43,27_2,Is a balanced diet the same for men as well as women?,"A balanced diet is a balanced diet that includes foods that are high in protein, low in carbohydrates, high in fat, and low in sugar.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
12,27_2,Is a balanced diet the same for men as well as women?,"A balanced diet is a healthy combination of both a balanced diet and a sensible gym routine tailored to meet your needs. Women are generally more aware of their health than men are, whereas men are often more into their fitness. It is a well known fact that women are much more likely to act upon a health concern and visit the doctors, whereas men will put it off for as long as possible.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
36,27_2,Is a balanced diet the same for men as well as women?,"A balanced diet is a healthy combination of both a balanced diet and a sensible gym routine tailored to meet your needs. Women are generally more aware of their health than men are, whereas men are often more into their fitness. It is a well known fact that women are much more likely to act upon a health concern and visit the doctors, whereas men will put it off for as long as possible.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
47,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that is high in protein and low in fat. Women should aim for a diet that is high in protein but low in fat. Men should aim for a diet high in protein but low in fat.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
61,27_2,Is a balanced diet the same for men as well as women?,A balanced diet is a diet that is high in protein and low in fat. Women should aim for a diet that is high in protein but low in fat. Men should aim for a diet high in protein but low in fat.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,273_3,Did Nando Reis find another band?,"Nando Reis formed his own band, Nando Reis and Friends.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,273_3,Did Nando Reis find another band?,"Nando Reis formed his own band, Nando Reis and Friends.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,273_3,Did Nando Reis find another band?,"” In the following year, the band saw the departure of vocalist and bassist Nando Reis, who has since lead a successful solo career (including songs penned for other artists) fronting his own band Nando Reis e os Infernais .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
4,273_3,Did Nando Reis find another band?,"” In the following year, the band saw the departure of vocalist and bassist Nando Reis, who has since lead a successful solo career (including songs penned for other artists) fronting his own band Nando Reis e os Infernais .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
26,273_3,Did Nando Reis find another band?,"Reis formed his own band, Fromer  Nando Reis.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
38,273_3,Did Nando Reis find another band?,"Reis formed his own band, Fromer  Nando Reis.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
32,274_2,"Was that 1969 trip, Lee Trevino's first time at the Masters?",Lee Trevino's first Masters victory came in 1969.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
36,274_2,"Was that 1969 trip, Lee Trevino's first time at the Masters?",Lee Trevino's first Masters victory came in 1969.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,"It doesn't state whether it was his first time there, only his first victory.",false,true,,
20,274_2,"Was that 1969 trip, Lee Trevino's first time at the Masters?",Lee Trevino's first Masters was in 1969.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,274_2,"Was that 1969 trip, Lee Trevino's first time at the Masters?",Lee Trevino's first Masters was in 1969.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,274_2,"Was that 1969 trip, Lee Trevino's first time at the Masters?",Lee Trevino's first time at the Masters was in 1969.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,274_2,"Was that 1969 trip, Lee Trevino's first time at the Masters?",Lee Trevino's first time at the Masters was in 1969.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
39,275_2,Did Larry Kudlow have other jobs in the government besides being associate director for economics and planning in the Office of Management and Budget?,"In addition to the director of the President's National Economic Council, Larry Kudlow has other jobs in the government the Trump administration made use of.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,true,false,,
8,275_2,Did Larry Kudlow have other jobs in the government besides being associate director for economics and planning in the Office of Management and Budget?,"In addition to the director of the President's National Economic Council, Larry Kudlow has other jobs in the government the Trump administration made use of.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,275_2,Did Larry Kudlow have other jobs in the government besides being associate director for economics and planning in the Office of Management and Budget?,Larry Kudlow served as the director of the National Economic Council during the first two years of the Trump administration.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
47,275_2,Did Larry Kudlow have other jobs in the government besides being associate director for economics and planning in the Office of Management and Budget?,Larry Kudlow served as the director of the National Economic Council during the first two years of the Trump administration.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
12,275_2,Did Larry Kudlow have other jobs in the government besides being associate director for economics and planning in the Office of Management and Budget?,Larry Kudlow has also served as director of the National Economic Council under President Trump.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
9,275_2,Did Larry Kudlow have other jobs in the government besides being associate director for economics and planning in the Office of Management and Budget?,Larry Kudlow has also served as director of the National Economic Council under President Trump.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
27,277_2,What was The Best in relation to the Kooks?,The Best of The Kooks is the fourth studio album by British rock band The Kooks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
103,277_2,What was The Best in relation to the Kooks?,The Best of The Kooks is the fourth studio album by British rock band The Kooks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,277_2,What was The Best in relation to the Kooks?,The Best of the Kooks is the third studio album by British rock band The Kooks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
32,277_2,What was The Best in relation to the Kooks?,The Best of the Kooks is the third studio album by British rock band The Kooks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,277_2,What was The Best in relation to the Kooks?,The Best in relation to the Kooks was The Best of... So Far.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
31,277_2,What was The Best in relation to the Kooks?,The Best in relation to the Kooks was The Best of... So Far.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,incomplete,false,false,,
23,277_3,What year was the album The Best of... So Far by the Kooks made?,The Best of... So Far was released on 19 May 2017.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,277_3,What year was the album The Best of... So Far by the Kooks made?,The Best of... So Far was released on 19 May 2017.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,277_3,What year was the album The Best of... So Far by the Kooks made?,The Kooks' greatest hits album The Best of... So Far was released on 19 May 2017 by Virgin and Astralwerks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,277_3,What year was the album The Best of... So Far by the Kooks made?,The Kooks' greatest hits album The Best of... So Far was released on 19 May 2017 by Virgin and Astralwerks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,277_3,What year was the album The Best of... So Far by the Kooks made?,The Best of... So Far by the Kooks was released on 19 May 2017.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,277_3,What year was the album The Best of... So Far by the Kooks made?,The Best of... So Far by the Kooks was released on 19 May 2017.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
26,277_3,What year was the album The Best of... So Far by the Kooks made?,"The Best of... So Far is a greatest hits album by British rock band The Kooks, released on 19 May 2017 by Virgin and Astralwerks.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,277_3,What year was the album The Best of... So Far by the Kooks made?,"The Best of... So Far is a greatest hits album by British rock band The Kooks, released on 19 May 2017 by Virgin and Astralwerks.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,278_1,When did Will Forte join SNL?,"After Will Ferrell's departure, Forte joined SNL in the wake of Ferrell's departure, in the wake of Will Ferrell's departure, he signed on.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
21,278_1,When did Will Forte join SNL?,"After Will Ferrell's departure, Forte joined SNL in the wake of Ferrell's departure, in the wake of Will Ferrell's departure, he signed on.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
19,278_1,When did Will Forte join SNL?,Will Forte joined SNL in the wake of Will Ferrell's departure in the wake of Will Ferrell's departure.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,278_1,When did Will Forte join SNL?,Will Forte joined SNL in the wake of Will Ferrell's departure in the wake of Will Ferrell's departure.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,278_1,When did Will Forte join SNL?,"After Will Ferrell's departure from SNL, Forte joined the cast in the wake of Ferrell's departure, signing on in the wake of Will Ferrell's departure.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
5,278_1,When did Will Forte join SNL?,"After Will Ferrell's departure from SNL, Forte joined the cast in the wake of Ferrell's departure, signing on in the wake of Will Ferrell's departure.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
9,28_1,Describe global warming.,Global warming refers to the upward temperature trend across the entire Earth since the early 20th century.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
42,28_1,Describe global warming.,Global warming refers to the upward temperature trend across the entire Earth since the early 20th century.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,28_1,Describe global warming.,"Global warming refers to the gradual increase, observed or projected, in global surface temperature, as one of the consequences of radiative forcing caused by anthropogenic emissions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,28_1,Describe global warming.,"Global warming refers to the gradual increase, observed or projected, in global surface temperature, as one of the consequences of radiative forcing caused by anthropogenic emissions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,28_1,Describe global warming.,Global warming is the increase in the average temperature of the Earth's atmosphere and oceans since the mid-20th century.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,28_1,Describe global warming.,Global warming is the increase in the average temperature of the Earth's atmosphere and oceans since the mid-20th century.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,28_1,Describe global warming.,global warming is the term used to describe a gradual increase in the average temperature of the earth's atmosphere and its,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
73,28_1,Describe global warming.,global warming is the term used to describe a gradual increase in the average temperature of the earth's atmosphere and its,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
23,28_1,Describe global warming.,global warming is the term used to describe a gradual increase in the average temperature of the,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
81,28_1,Describe global warming.,global warming is the term used to describe a gradual increase in the average temperature of the,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
12,280_1,Was Country Club Travis Tritt's first album?,Country Club is Travis Tritt's first album,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
58,280_1,Was Country Club Travis Tritt's first album?,Country Club is Travis Tritt's first album,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
23,280_1,Was Country Club Travis Tritt's first album?,Country Club is the first studio album by American country music singer Travis Tritt.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,280_1,Was Country Club Travis Tritt's first album?,Country Club is the first studio album by American country music singer Travis Tritt.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
34,280_1,Was Country Club Travis Tritt's first album?,From the Beginning is the first studio album by American country music singer Travis Tritt.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,280_1,Was Country Club Travis Tritt's first album?,From the Beginning is the first studio album by American country music singer Travis Tritt.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
33,280_1,Was Country Club Travis Tritt's first album?,Country Club Travis Tritt is the second studio album by American country music singer Travis Tritt.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
95,280_1,Was Country Club Travis Tritt's first album?,Country Club Travis Tritt is the second studio album by American country music singer Travis Tritt.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
48,280_1,Was Country Club Travis Tritt's first album?,Country Club Travis Tritt is the debut studio album by American country singer Travis Tritt.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,280_1,Was Country Club Travis Tritt's first album?,Country Club Travis Tritt is the debut studio album by American country singer Travis Tritt.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
7,280_2,When was the album Country Club by Travis Tritt released?,"Country Club by Travis Tritt was released on October 25, 2011.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,280_2,When was the album Country Club by Travis Tritt released?,"Country Club by Travis Tritt was released on October 25, 2011.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,280_2,When was the album Country Club by Travis Tritt released?,The album Country Club by Travis Tritt was released in 1990 by Warner Bros. Records.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,280_2,When was the album Country Club by Travis Tritt released?,The album Country Club by Travis Tritt was released in 1990 by Warner Bros. Records.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,280_2,When was the album Country Club by Travis Tritt released?,"Country Club is the third studio album by American country music artist Travis Tritt. It was released on October 26, 2002.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,280_2,When was the album Country Club by Travis Tritt released?,"Country Club is the third studio album by American country music artist Travis Tritt. It was released on October 26, 2002.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,280_6,Did any other singles on the album Country Club by Travis Tritt stand out besides Help Me Hold On,The first single from the album Country Club by Travis Tritt was Country Club.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,280_6,Did any other singles on the album Country Club by Travis Tritt stand out besides Help Me Hold On,The first single from the album Country Club by Travis Tritt was Country Club.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
30,280_6,Did any other singles on the album Country Club by Travis Tritt stand out besides Help Me Hold On,All the other singles except for Put Some Drive in Your Country reached Top Ten.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,280_6,Did any other singles on the album Country Club by Travis Tritt stand out besides Help Me Hold On,All the other singles except for Put Some Drive in Your Country reached Top Ten.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,280_6,Did any other singles on the album Country Club by Travis Tritt stand out besides Help Me Hold On,"The first single from Travis Tritt's album, Country Club by Travis Tritt, reached number one on the Billboard Hot Country Singles & Tracks chart.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
22,280_6,Did any other singles on the album Country Club by Travis Tritt stand out besides Help Me Hold On,"The first single from Travis Tritt's album, Country Club by Travis Tritt, reached number one on the Billboard Hot Country Singles & Tracks chart.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
9,281_3,Where did Stu Kerr hire Kevin Clash?,"While appearing at a neighborhood festival, Kevin Clash was discovered by Stu Kerr, who became Clash's first mentor and hired him to perform in the children's show Caboose at Channel 2.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,281_3,Where did Stu Kerr hire Kevin Clash?,"While appearing at a neighborhood festival, Kevin Clash was discovered by Stu Kerr, who became Clash's first mentor and hired him to perform in the children's show Caboose at Channel 2.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
25,281_3,Where did Stu Kerr hire Kevin Clash?,who became clash's first mentor and hired him to perform in the children's show caboose at channel 2.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
5,281_3,Where did Stu Kerr hire Kevin Clash?,who became clash's first mentor and hired him to perform in the children's show caboose at channel 2.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
11,281_3,Where did Stu Kerr hire Kevin Clash?,"While appearing at a neighborhood festival, Clash was discovered by Stu Kerr, who became Clash's first mentor and hired him to perform in the children's show Caboose at Channel 2.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
49,281_3,Where did Stu Kerr hire Kevin Clash?,"While appearing at a neighborhood festival, Clash was discovered by Stu Kerr, who became Clash's first mentor and hired him to perform in the children's show Caboose at Channel 2.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,282_3,Did Jessi Colter have any hit singles?,"I'm Not Lisa became Jessi Colter's first major hit, and What's Happened to Blue Eyes peaked at #5 on the Billboard Country Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
21,282_3,Did Jessi Colter have any hit singles?,"I'm Not Lisa became Jessi Colter's first major hit, and What's Happened to Blue Eyes peaked at #5 on the Billboard Country Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
40,282_3,Did Jessi Colter have any hit singles?,I'm Not Lisa peaked at #1 on the country chart and #4 on the Billboard Hot 100.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,282_3,Did Jessi Colter have any hit singles?,I'm Not Lisa peaked at #1 on the country chart and #4 on the Billboard Hot 100.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,282_3,Did Jessi Colter have any hit singles?,"The album spawned two major hits: I'm Not Lisa, which became Jessi Colter's first major hit, and What's Happened to Blue Eyes, which peaked at #5 on the Billboard Country Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,282_3,Did Jessi Colter have any hit singles?,"The album spawned two major hits: I'm Not Lisa, which became Jessi Colter's first major hit, and What's Happened to Blue Eyes, which peaked at #5 on the Billboard Country Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,283_2,Did Jessi Colter make any albums with her return to music?,"In 2006, Jessi Colter returned to recording with a new studio album released on the Shout! Factory label, Out of the Blue.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
67,283_2,Did Jessi Colter make any albums with her return to music?,"In 2006, Jessi Colter returned to recording with a new studio album released on the Shout! Factory label, Out of the Blue.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
19,283_2,Did Jessi Colter make any albums with her return to music?,"Out of the Ashes is the 11th studio album by American country artist Jessi Colter, released in 2006 on Shout! Factory Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
4,283_2,Did Jessi Colter make any albums with her return to music?,"Out of the Ashes is the 11th studio album by American country artist Jessi Colter, released in 2006 on Shout! Factory Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
4,283_2,Did Jessi Colter make any albums with her return to music?,"Jessi Colter returned to recording with a new album, Out of the Ashes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
16,283_2,Did Jessi Colter make any albums with her return to music?,"Jessi Colter returned to recording with a new album, Out of the Ashes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,283_3,How did the album Out of the Ashes by Jessi Colter do?,"Out of the Ashes was Jessi Colter's first album since 1981 to chart on the Top Country Albums chart, peaking at No. 61.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
20,283_3,How did the album Out of the Ashes by Jessi Colter do?,"Out of the Ashes was Jessi Colter's first album since 1981 to chart on the Top Country Albums chart, peaking at No. 61.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,283_3,How did the album Out of the Ashes by Jessi Colter do?,Out of the Ashes by Jessi Colter reached #61 on the Top Country Albums chart.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,283_3,How did the album Out of the Ashes by Jessi Colter do?,Out of the Ashes by Jessi Colter reached #61 on the Top Country Albums chart.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,283_3,How did the album Out of the Ashes by Jessi Colter do?,Out of the Ashes by Jessi Colter debuted at No. 1 on the Billboard 200 and at No. 1 on the Top Country Albums chart.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,283_3,How did the album Out of the Ashes by Jessi Colter do?,Out of the Ashes by Jessi Colter debuted at No. 1 on the Billboard 200 and at No. 1 on the Top Country Albums chart.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
28,283_3,How did the album Out of the Ashes by Jessi Colter do?,"Out of the Ashes was Jessi Colter's first album in 10 years, and her first country music album in 22 years since 1984's Rock and Roll Lullaby.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
17,283_3,How did the album Out of the Ashes by Jessi Colter do?,"Out of the Ashes was Jessi Colter's first album in 10 years, and her first country music album in 22 years since 1984's Rock and Roll Lullaby.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,283_3,How did the album Out of the Ashes by Jessi Colter do?,Out of the Ashes was her first album since 1981 to chart on the Top Country Albums chart.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
13,283_3,How did the album Out of the Ashes by Jessi Colter do?,Out of the Ashes was her first album since 1981 to chart on the Top Country Albums chart.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
16,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Romero co-starred with Carmen Miranda and Betty Grable in Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
53,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Romero co-starred with Carmen Miranda and Betty Grable in Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
60,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Cesar Romero and performed comedy in the 20th Century Fox films he starred in, such as Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,true,false,,
13,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Cesar Romero and performed comedy in the 20th Century Fox films he starred in, such as Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,,
7,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Cesar Romero starred in the 20th Century Fox films he starred in opposite Carmen Miranda and Betty Grable, such as Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Cesar Romero starred in the 20th Century Fox films he starred in opposite Carmen Miranda and Betty Grable, such as Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
44,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Cesar Romero danced and performed comedy in the 20th Century Fox films he starred in with Carmen Miranda and Betty Grable, such as Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,285_3,What movie was Cesar Romero in with Carmen Miranda and Betty Grable?,"Cesar Romero danced and performed comedy in the 20th Century Fox films he starred in with Carmen Miranda and Betty Grable, such as Week-End in Havana and Springtime in the Rockies, in the 1940s.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,287_2,What was Bobby Womack addicted to?,Bobby Womack was addicted to heroin.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,287_2,What was Bobby Womack addicted to?,Bobby Womack was addicted to heroin.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,287_2,What was Bobby Womack addicted to?,Bobby Womack said he began using cocaine as a teenager.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,287_2,What was Bobby Womack addicted to?,Bobby Womack said he began using cocaine as a teenager.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
6,287_2,What was Bobby Womack addicted to?,Womack's cocaine use turned into an addiction by the late 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,287_2,What was Bobby Womack addicted to?,Womack's cocaine use turned into an addiction by the late 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
15,287_2,What was Bobby Womack addicted to?,"Throughout most of the 1980s, Bobby Womack struggled with a worsening addiction.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
2,287_2,What was Bobby Womack addicted to?,"Throughout most of the 1980s, Bobby Womack struggled with a worsening addiction.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,287_2,What was Bobby Womack addicted to?,His cocaine use turned into an addiction by the late 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
16,287_2,What was Bobby Womack addicted to?,His cocaine use turned into an addiction by the late 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
41,287_2,What was Bobby Womack addicted to?,Bobby Womack said he began using cocaine sometime in the late 1960s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
72,287_2,What was Bobby Womack addicted to?,Bobby Womack said he began using cocaine sometime in the late 1960s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,"The response is related to the question's topic, but does not answer the question. So I've selected ""No"".",false,true,,
7,287_2,What was Bobby Womack addicted to?,[ 45 ] womack said he began using cocaine sometime in the late 1960s,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
25,287_2,What was Bobby Womack addicted to?,[ 45 ] womack said he began using cocaine sometime in the late 1960s,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
22,287_2,What was Bobby Womack addicted to?,"Bobby Womack said he began using cocaine sometime in the late 1960s. He had become close friends with Sly Stone, and was an enthusiastic participant in Stone's infamous drug binges.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,287_2,What was Bobby Womack addicted to?,"Bobby Womack said he began using cocaine sometime in the late 1960s. He had become close friends with Sly Stone, and was an enthusiastic participant in Stone's infamous drug binges.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,289_7,Did Girls' Generation sell many debut albums?,"Girls' Generation's self-titled debut studio album in November 2007 became the twelfth best-selling album of 2007 in South Korea, selling 56,804 copies.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,289_7,Did Girls' Generation sell many debut albums?,"Girls' Generation's self-titled debut studio album in November 2007 became the twelfth best-selling album of 2007 in South Korea, selling 56,804 copies.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,289_7,Did Girls' Generation sell many debut albums?,girls'generation became the twelfth best - selling album of 2007 in south korea,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
14,289_7,Did Girls' Generation sell many debut albums?,girls'generation became the twelfth best - selling album of 2007 in south korea,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
8,289_7,Did Girls' Generation sell many debut albums?,"Girls' Generation became the twelfth best-selling album of 2007 in South Korea, selling 56,804 copies.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,289_7,Did Girls' Generation sell many debut albums?,"Girls' Generation became the twelfth best-selling album of 2007 in South Korea, selling 56,804 copies.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,289_8,What were Girls' Generation doing in 2008?,"In 2008, Girls' Generation released their second studio album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,289_8,What were Girls' Generation doing in 2008?,"In 2008, Girls' Generation released their second studio album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,289_8,What were Girls' Generation doing in 2008?,"In 2008, Girls' Generation released their second studio album, titled Girls' Generation 2.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,289_8,What were Girls' Generation doing in 2008?,"In 2008, Girls' Generation released their second studio album, titled Girls' Generation 2.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,289_8,What were Girls' Generation doing in 2008?,"In 2008, Girls' Generation released their third studio album, Girls' Generation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,289_8,What were Girls' Generation doing in 2008?,"In 2008, Girls' Generation released their third studio album, Girls' Generation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,289_8,What were Girls' Generation doing in 2008?,"Girls' Generation released their fourth studio album, Girls' Generation, in 2008.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,289_8,What were Girls' Generation doing in 2008?,"Girls' Generation released their fourth studio album, Girls' Generation, in 2008.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
60,29_1,What is the British Invasion in music?,The British Invasion was a cultural phenomenon of the mid-1960s.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
31,29_1,What is the British Invasion in music?,The British Invasion was a cultural phenomenon of the mid-1960s.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
10,29_1,What is the British Invasion in music?,The British Invasion of the 1960s is a period of British popular music in the 1960s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
31,29_1,What is the British Invasion in music?,The British Invasion of the 1960s is a period of British popular music in the 1960s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,29_1,What is the British Invasion in music?,The British Invasion of the 1960s was a period in British music during the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,29_1,What is the British Invasion in music?,The British Invasion of the 1960s was a period in British music during the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,29_1,What is the British Invasion in music?,The British Invasion of the 1960s is a period of British influence on American popular music.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,29_1,What is the British Invasion in music?,The British Invasion of the 1960s is a period of British influence on American popular music.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
104,29_1,What is the British Invasion in music?,The British Invasion was a musical movement that took place in the United States in the 1960s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
86,29_1,What is the British Invasion in music?,The British Invasion was a musical movement that took place in the United States in the 1960s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,29_1,What is the British Invasion in music?,The British Invasion of the 1960s was a wave of British music that swept across the United States in the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
103,29_1,What is the British Invasion in music?,The British Invasion of the 1960s was a wave of British music that swept across the United States in the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,29_1,What is the British Invasion in music?,The British Invasion of the 1960s was the period of the British Invasion of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
62,29_1,What is the British Invasion in music?,The British Invasion of the 1960s was the period of the British Invasion of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
54,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period of British Invasion of the 1960s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
88,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period of British Invasion of the 1960s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
24,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period in British music during the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,true,false,correct answer,
9,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period in British music during the late 1960s and early 1970s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,random answer,
29,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s happened in the late 1960s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
45,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s happened in the late 1960s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
77,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period of British invasion of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period of British invasion of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
100,29_2,What era did the British Invasion in music happen?,The British Invasion took place in the 1960s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
80,29_2,What era did the British Invasion in music happen?,The British Invasion took place in the 1960s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
25,29_2,What era did the British Invasion in music happen?,the british invasion of the 1960s were an era in which most,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
25,29_2,What era did the British Invasion in music happen?,the british invasion of the 1960s were an era in which most,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,random answer,
15,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period in the history of popular music.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
5,29_2,What era did the British Invasion in music happen?,The British Invasion of the 1960s was a period in the history of popular music.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,291_1,What is Revenge relative to Eurythmics?,Revenge is Eurythmics' third album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,291_1,What is Revenge relative to Eurythmics?,Revenge is Eurythmics' third album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,291_1,What is Revenge relative to Eurythmics?,Revenge is the fifth studio album by British new wave duo Eurythmics. It was released on 30 June 1986 by RCA Records.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,291_1,What is Revenge relative to Eurythmics?,Revenge is the fifth studio album by British new wave duo Eurythmics. It was released on 30 June 1986 by RCA Records.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,291_1,What is Revenge relative to Eurythmics?,Revenge is the third studio album by English electronic music duo Eurythmics.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,291_1,What is Revenge relative to Eurythmics?,Revenge is the third studio album by English electronic music duo Eurythmics.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the third studio album by the Eurythmics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
61,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the third studio album by the Eurythmics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
19,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the third studio album by English electronic music duo Eurythmics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the third studio album by English electronic music duo Eurythmics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
26,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the third studio album by American rock band We Too Are One.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
39,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the third studio album by American rock band We Too Are One.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
16,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the seventh studio album by British pop duo Eurythmics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
48,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the seventh studio album by British pop duo Eurythmics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
30,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the seventh studio album by Eurythmics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the seventh studio album by Eurythmics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the second studio album by American rock band We Too Are One.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
16,291_8,What is We Too Are One relative to Eurythmics?,We Too Are One is the second studio album by American rock band We Too Are One.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,true,false,,
4,291_9,Was the album We Too Are One by Eurythmics successful?,We Too Are One is the seventh studio album by British new wave duo Eurythmics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
69,291_9,Was the album We Too Are One by Eurythmics successful?,We Too Are One is the seventh studio album by British new wave duo Eurythmics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
6,291_9,Was the album We Too Are One by Eurythmics successful?,"In 1989, Eurythmics released the album We Too Are One, which entered the UK Albumc Chart at No. 1 and gave the duo four UK Top 30 hit singles.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,291_9,Was the album We Too Are One by Eurythmics successful?,"In 1989, Eurythmics released the album We Too Are One, which entered the UK Albumc Chart at No. 1 and gave the duo four UK Top 30 hit singles.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,291_9,Was the album We Too Are One by Eurythmics successful?,The album We Too Are One by Eurythmics entered the UK Albumc Chart at No. 1 and gave the duo four UK Top 30 hit singles.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
59,291_9,Was the album We Too Are One by Eurythmics successful?,The album We Too Are One by Eurythmics entered the UK Albumc Chart at No. 1 and gave the duo four UK Top 30 hit singles.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
24,292_1,Who is Wilhelm Fliess relative to Sigmund Freud?,Wilhelm Fliess is a relative of Sigmund Freud.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
13,292_1,Who is Wilhelm Fliess relative to Sigmund Freud?,Wilhelm Fliess is a relative of Sigmund Freud.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,292_1,Who is Wilhelm Fliess relative to Sigmund Freud?,Wilhelm Fliess was a close friend of Sigmund Freud.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,292_1,Who is Wilhelm Fliess relative to Sigmund Freud?,Wilhelm Fliess was a close friend of Sigmund Freud.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
24,292_1,Who is Wilhelm Fliess relative to Sigmund Freud?,"Wilhelm Flies (born 13 October 1858) was a German otolaryngologist, psychotherapist, and friend of Sigmund Freud.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
31,292_1,Who is Wilhelm Fliess relative to Sigmund Freud?,"Wilhelm Flies (born 13 October 1858) was a German otolaryngologist, psychotherapist, and friend of Sigmund Freud.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
56,292_6,Was Emma Eckstein's treatment by removal of part of the middle turbinate by Wilhelm Fliess successful?,"Wilhelm Fliess's surgery proved disastrous, resulting in profuse, recurrent nasal bleeding – he had left a half-metre of gauze in Emma Eckstein's nasal cavity.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
21,292_6,Was Emma Eckstein's treatment by removal of part of the middle turbinate by Wilhelm Fliess successful?,"Wilhelm Fliess's surgery proved disastrous, resulting in profuse, recurrent nasal bleeding – he had left a half-metre of gauze in Emma Eckstein's nasal cavity.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,292_6,Was Emma Eckstein's treatment by removal of part of the middle turbinate by Wilhelm Fliess successful?,"Wilhelm Fliess's surgery proved disastrous, resulting in profuse, recurrent nasal bleeding – he had left a half-metre of gauze in Eckstein's nasal cavity – the subsequent removal of which left her permanently disfigured.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,292_6,Was Emma Eckstein's treatment by removal of part of the middle turbinate by Wilhelm Fliess successful?,"Wilhelm Fliess's surgery proved disastrous, resulting in profuse, recurrent nasal bleeding – he had left a half-metre of gauze in Eckstein's nasal cavity – the subsequent removal of which left her permanently disfigured.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
37,292_6,Was Emma Eckstein's treatment by removal of part of the middle turbinate by Wilhelm Fliess successful?,"Fliess's surgery proved disastrous, resulting in profuse, recurrent nasal bleeding – he had left a half-metre of gauze in Emma Eckstein's nasal cavity – the subsequent removal of which left her permanently disfigured.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
19,292_6,Was Emma Eckstein's treatment by removal of part of the middle turbinate by Wilhelm Fliess successful?,"Fliess's surgery proved disastrous, resulting in profuse, recurrent nasal bleeding – he had left a half-metre of gauze in Emma Eckstein's nasal cavity – the subsequent removal of which left her permanently disfigured.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
112,297_1,When did Nancy Grace's broadcasting career start?,"After leaving the Fulton County prosecutors' office, Grace was approached by and accepted an offer from Court TV founder Steven Church to do a legal commentary show alongside Johnnie Cochran.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,297_1,When did Nancy Grace's broadcasting career start?,"After leaving the Fulton County prosecutors' office, Grace was approached by and accepted an offer from Court TV founder Steven Church to do a legal commentary show alongside Johnnie Cochran.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,297_1,When did Nancy Grace's broadcasting career start?,grace was approached by and accepted an offer from court tv founder steven brill to do a legal commentary show alongside johnnie cochran.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
23,297_1,When did Nancy Grace's broadcasting career start?,grace was approached by and accepted an offer from court tv founder steven brill to do a legal commentary show alongside johnnie cochran.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
18,297_1,When did Nancy Grace's broadcasting career start?,"After leaving the Fulton County prosecutors' office, Grace was approached by and accepted an offer from Court TV founder Steven Cochran to do a legal commentary show alongside Johnnie Cochran.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,297_1,When did Nancy Grace's broadcasting career start?,"After leaving the Fulton County prosecutors' office, Grace was approached by and accepted an offer from Court TV founder Steven Cochran to do a legal commentary show alongside Johnnie Cochran.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,297_1,When did Nancy Grace's broadcasting career start?,"After leaving the Fulton County prosecutors' office, Nancy Grace was approached by and accepted an offer from Court TV founder Steven Brill to do a legal commentary show alongside Johnnie Cochran.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,297_1,When did Nancy Grace's broadcasting career start?,"After leaving the Fulton County prosecutors' office, Nancy Grace was approached by and accepted an offer from Court TV founder Steven Brill to do a legal commentary show alongside Johnnie Cochran.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
7,298_1,What was Operation Torch in World War II?,Operation Torch was the Allied invasion of North Africa.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,298_1,What was Operation Torch in World War II?,Operation Torch was the Allied invasion of North Africa.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,298_1,What was Operation Torch in World War II?,Operation Torch was an American invasion of North Africa during World War II.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,298_1,What was Operation Torch in World War II?,Operation Torch was an American invasion of North Africa during World War II.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,298_1,What was Operation Torch in World War II?,Operation Torch was the invasion of French North Africa by the Allies in 1942.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,298_1,What was Operation Torch in World War II?,Operation Torch was the invasion of French North Africa by the Allies in 1942.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,298_1,What was Operation Torch in World War II?,Operation Torch was the Allied invasion of North Africa during World War II.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,298_1,What was Operation Torch in World War II?,Operation Torch was the Allied invasion of North Africa during World War II.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,3_1,Tell me about the types of irregular heart beat.,Atrial fibrillation is the most common type of irregular heartbeat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
84,3_1,Tell me about the types of irregular heart beat.,Atrial fibrillation is the most common type of irregular heartbeat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
36,3_1,Tell me about the types of irregular heart beat.,"Atrial fibrillation is a very common irregular heart rhythm that causes the atria, the upper chambers of the heart, to contract",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
46,3_1,Tell me about the types of irregular heart beat.,"Atrial fibrillation is a very common irregular heart rhythm that causes the atria, the upper chambers of the heart, to contract",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
16,3_1,Tell me about the types of irregular heart beat.,Atrial fibrillation is a condition in which the upper two chambers of the heart beat quickly and irregularly.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
97,3_1,Tell me about the types of irregular heart beat.,Atrial fibrillation is a condition in which the upper two chambers of the heart beat quickly and irregularly.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,true,false,random answer,
10,3_1,Tell me about the types of irregular heart beat.,The most common types of irregular heart beat are atrial fibrillation and atrial fibrillation.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,3_1,Tell me about the types of irregular heart beat.,The most common types of irregular heart beat are atrial fibrillation and atrial fibrillation.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
70,3_1,Tell me about the types of irregular heart beat.,atrial fibrillation is a condition in which the upper two chambers of the heart,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,malformed answer,
12,3_1,Tell me about the types of irregular heart beat.,atrial fibrillation is a condition in which the upper two chambers of the heart,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,malformed answer,
12,3_4,What is atrial flutter?,Atrial flutter is a condition in which the heart beats irregularly.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
23,3_4,What is atrial flutter?,Atrial flutter is a condition in which the heart beats irregularly.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
68,3_4,What is atrial flutter?,"Atrial flutter (AFL) is a type of abnormal heart rate, or arrhythmia. It occurs when the upper chambers",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,good,false,false,,
71,3_4,What is atrial flutter?,"Atrial flutter (AFL) is a type of abnormal heart rate, or arrhythmia. It occurs when the upper chambers",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
27,3_4,What is atrial flutter?,"Atrial flutter is a problem with way your heart beats. Such problems, whether in the rhythm or speed of the heartbeat, are known as arrhythmias.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
85,3_4,What is atrial flutter?,"Atrial flutter is a problem with way your heart beats. Such problems, whether in the rhythm or speed of the heartbeat, are known as arrhythmias.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,3_4,What is atrial flutter?,Atrial flutter is a problem with way your heart beats.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,3_4,What is atrial flutter?,Atrial flutter is a problem with way your heart beats.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,3_6,What's the difference between flutter and fibrillation?,Atrial flutter and atrial fibrillation are both abnormal heart rhythms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,nice,false,false,confusing answer,
21,3_6,What's the difference between flutter and fibrillation?,Atrial flutter and atrial fibrillation are both abnormal heart rhythms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
33,3_6,What's the difference between flutter and fibrillation?,"Atrial fibrillation is an abnormal heart rhythm. Atrial flutter is less common, but has symptoms (feeling faint, tiredness, palpitations, shortness of breath or dizziness).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
49,3_6,What's the difference between flutter and fibrillation?,"Atrial fibrillation is an abnormal heart rhythm. Atrial flutter is less common, but has symptoms (feeling faint, tiredness, palpitations, shortness of breath or dizziness).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,very nice,false,false,,
66,3_6,What's the difference between flutter and fibrillation?,Atrial flutter and atrial fibrillation are both abnormal heart rhythms. They occur when there is an issue with the electrical signals and pathways in your heart.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
8,3_6,What's the difference between flutter and fibrillation?,Atrial flutter and atrial fibrillation are both abnormal heart rhythms. They occur when there is an issue with the electrical signals and pathways in your heart.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
19,3_7,How does atrial fibrillation affect electrocardiography?,"Atrial fibrillation can occur when the heart's electrical activity is abnormally low, causing the heart to beat abnormally.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,correct answer,
54,3_7,How does atrial fibrillation affect electrocardiography?,"Atrial fibrillation can occur when the heart's electrical activity is abnormally low, causing the heart to beat abnormally.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,random answer,
23,3_7,How does atrial fibrillation affect electrocardiography?,Atrial fibrillation is an abnormal heart rhythm that can occur at rest or during exercise. This can lead to arrhythmias such as bradycardia and supraventricular tachycardia.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,correct answer,
43,3_7,How does atrial fibrillation affect electrocardiography?,Atrial fibrillation is an abnormal heart rhythm that can occur at rest or during exercise. This can lead to arrhythmias such as bradycardia and supraventricular tachycardia.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,random answer,
8,3_7,How does atrial fibrillation affect electrocardiography?,Atrial fibrillation is an abnormal heart rhythm that occurs when the upper chambers of the heart do not contract properly.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,3_7,How does atrial fibrillation affect electrocardiography?,Atrial fibrillation is an abnormal heart rhythm that occurs when the upper chambers of the heart do not contract properly.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,nice,false,false,,
58,30_1,What are some advantages of using Linux?,One of the main advantages of Linux is that it is an open source operating system.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
50,30_1,What are some advantages of using Linux?,One of the main advantages of Linux is that it is an open source operating system.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,30_1,What are some advantages of using Linux?,One advantage of using Linux is that it can be used as an alternative to proprietary software.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
23,30_1,What are some advantages of using Linux?,One advantage of using Linux is that it can be used as an alternative to proprietary software.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,NICE,false,false,,
43,30_1,What are some advantages of using Linux?,"Some advantages of using Linux include the ability to create, modify, and distribute software.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
32,30_1,What are some advantages of using Linux?,"Some advantages of using Linux include the ability to create, modify, and distribute software.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
38,30_1,What are some advantages of using Linux?,The advantages of using the open source operating system include:,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,correct answer,
12,30_1,What are some advantages of using Linux?,The advantages of using the open source operating system include:,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,random answer,
38,30_4,Which of Linux and Windows is more popular?,"Currently, Linux and Windows are the two most popular operating systems.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
83,30_4,Which of Linux and Windows is more popular?,"Currently, Linux and Windows are the two most popular operating systems.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,random answer,
9,30_4,Which of Linux and Windows is more popular?,Linux is more popular than Windows.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
80,30_4,Which of Linux and Windows is more popular?,Linux is more popular than Windows.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,true,false,random answer,
27,30_4,Which of Linux and Windows is more popular?,Windows and Linux are the two most popular operating systems being offered by providers.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,correct answer,
14,30_4,Which of Linux and Windows is more popular?,Windows and Linux are the two most popular operating systems being offered by providers.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,random answer,
62,30_4,Which of Linux and Windows is more popular?,Windows is the most popular of the two operating systems.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
59,30_4,Which of Linux and Windows is more popular?,Windows is the most popular of the two operating systems.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,random answer,
9,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,"Carl Lewis won the 200 m on June 19 at the TAC/Mobil Championships in 19.75 s, the second-fastest time in history and the low-altitude record, only 0.03 s behind Pietro Mennea's mark.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,"Carl Lewis won the 200 m on June 19 at the TAC/Mobil Championships in 19.75 s, the second-fastest time in history and the low-altitude record, only 0.03 s behind Pietro Mennea's mark.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,he won the 200 m on june 19 at the tac / mobil championships in 19. 75 s,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
74,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,he won the 200 m on june 19 at the tac / mobil championships in 19. 75 s,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
5,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,"He won the 200 m on June 19 at the TAC/Mobil Championships in 19.75 s, the second-fastest time in history and the low-altitude record, only 0.03 s behind Pietro Mennea's 1979 mark.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,"He won the 200 m on June 19 at the TAC/Mobil Championships in 19.75 s, the second-fastest time in history and the low-altitude record, only 0.03 s behind Pietro Mennea's 1979 mark.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
7,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,"Carl Lewis won the 200 m on June 19 at the 1983 TAC/Mobil Championships in 19.75 seconds, the second-fastest time in history and the low-altitude record.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,301_3,Did Carl Lewis win any events at the 1983 TAC/Mobil Championships?,"Carl Lewis won the 200 m on June 19 at the 1983 TAC/Mobil Championships in 19.75 seconds, the second-fastest time in history and the low-altitude record.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,The Bharatiya Kisan Sangh is an Indian farmers' representative organization affiliated with the Rashtriya Swayamsevak Sangh.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,The Bharatiya Kisan Sangh is an Indian farmers' representative organization affiliated with the Rashtriya Swayamsevak Sangh.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,"The Bharatiya Kisan Sangh (BKS) is an Indian farmers' representative organization affiliated with the Rashtriya Swayamsevak Sangh,",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,"The Bharatiya Kisan Sangh (BKS) is an Indian farmers' representative organization affiliated with the Rashtriya Swayamsevak Sangh,",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,"india region served india head dinesh kulkarni parent organization rashtriya swayamsevak sangh affiliations sangh parivar website bharatiyakisansangh. org the bharatiya kisan sangh ( bks ) ( english : indian farmers'collective ) is an indian farmers'representative organization affiliated with the rashtriya swayamsevak sangh,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
12,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,"india region served india head dinesh kulkarni parent organization rashtriya swayamsevak sangh affiliations sangh parivar website bharatiyakisansangh. org the bharatiya kisan sangh ( bks ) ( english : indian farmers'collective ) is an indian farmers'representative organization affiliated with the rashtriya swayamsevak sangh,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
5,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,"The Bharatiya Kisan Sangh (BKS) is an Indian farmers' representative organization affiliated with the Rashtriya Swayamsevak Sangh, and a member of the Sangh Parivar.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,305_7,What does Bharatiya Kisan Sangh or BKS stand for?,"The Bharatiya Kisan Sangh (BKS) is an Indian farmers' representative organization affiliated with the Rashtriya Swayamsevak Sangh, and a member of the Sangh Parivar.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
7,306_2,Who were Dion and the Belmonts' members?,"Carlo Mastrangelo, Fred Milano, and Angelo D'Aleo",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
77,306_2,Who were Dion and the Belmonts' members?,"Carlo Mastrangelo, Fred Milano, and Angelo D'Aleo",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,306_2,Who were Dion and the Belmonts' members?,"Dion DiMucci, Carlo Mastrangelo, and Fred Milano",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,306_2,Who were Dion and the Belmonts' members?,"Dion DiMucci, Carlo Mastrangelo, and Fred Milano",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,306_2,Who were Dion and the Belmonts' members?,"The established trio of Angelo D'Aleo (born February 3, 1940), Carlo Mastrangelo (October 5, 1937 – April 4, 2016), and Fred Milano (August 26, 1939 – January 1, 2012), formed a quartet with Dion DiMucci.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
44,306_2,Who were Dion and the Belmonts' members?,"The established trio of Angelo D'Aleo (born February 3, 1940), Carlo Mastrangelo (October 5, 1937 – April 4, 2016), and Fred Milano (August 26, 1939 – January 1, 2012), formed a quartet with Dion DiMucci.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,306_5,Did Dion and the Belmonts tour?,"The Belmonts toured with Dion and the Belmonts on the ill-fated Winter Dance Party tour with Holly, Ritchie Valens, the Big Bopper (J.P. Richardson), Frankie Sardo, and other performers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
72,306_5,Did Dion and the Belmonts tour?,"The Belmonts toured with Dion and the Belmonts on the ill-fated Winter Dance Party tour with Holly, Ritchie Valens, the Big Bopper (J.P. Richardson), Frankie Sardo, and other performers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,306_5,Did Dion and the Belmonts tour?,"This success won a place for Dion and the Belmonts on the ill-fated The Winter Dance Party tour with Buddy Holly, Ritchie Valens, the Big Bopper, Frankie Sardo, and other nationally televised performers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
19,306_5,Did Dion and the Belmonts tour?,"This success won a place for Dion and the Belmonts on the ill-fated The Winter Dance Party tour with Buddy Holly, Ritchie Valens, the Big Bopper, Frankie Sardo, and other nationally televised performers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,,
46,306_5,Did Dion and the Belmonts tour?,"This success won a place for Dion and the Belmonts on the ill-fated The Winter Dance Party tour with Buddy Holly, Ritchie Valens, the Big Bopper, Frankie Sardo, and other performers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,306_5,Did Dion and the Belmonts tour?,"This success won a place for Dion and the Belmonts on the ill-fated The Winter Dance Party tour with Buddy Holly, Ritchie Valens, the Big Bopper, Frankie Sardo, and other performers.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
3,306_7,Why did Dion DiMucci check into the hospital in 1960?,"In early 1960, Dion checked into a hospital for heroin addiction, a problem he had since his mid-teens.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,306_7,Why did Dion DiMucci check into the hospital in 1960?,"In early 1960, Dion checked into a hospital for heroin addiction, a problem he had since his mid-teens.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,306_7,Why did Dion DiMucci check into the hospital in 1960?,Dion DiMucci was also struggling with a heroin problem at the time.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,306_7,Why did Dion DiMucci check into the hospital in 1960?,Dion DiMucci was also struggling with a heroin problem at the time.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,306_7,Why did Dion DiMucci check into the hospital in 1960?,"The Belmonts checked into a hospital for heroin addiction, a problem he had since his mid-teens.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,306_7,Why did Dion DiMucci check into the hospital in 1960?,"The Belmonts checked into a hospital for heroin addiction, a problem he had since his mid-teens.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
5,306_7,Why did Dion DiMucci check into the hospital in 1960?,[ 4 ] dimucci was also struggling with a heroin problem at the time,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,306_7,Why did Dion DiMucci check into the hospital in 1960?,[ 4 ] dimucci was also struggling with a heroin problem at the time,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
9,306_7,Why did Dion DiMucci check into the hospital in 1960?,"Dion checked into the hospital for heroin addiction, a problem he had since his mid-teens.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
33,306_7,Why did Dion DiMucci check into the hospital in 1960?,"Dion checked into the hospital for heroin addiction, a problem he had since his mid-teens.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,309_6,"Did Viola Liuzzo have any children with her second husband, George Argyris?","In 1943 Viola Liuzzo married George Argyris, the manager of a restaurant where she worked. They had two children, Penny and Evangeline Mary, and divorced in 1949.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,309_6,"Did Viola Liuzzo have any children with her second husband, George Argyris?","In 1943 Viola Liuzzo married George Argyris, the manager of a restaurant where she worked. They had two children, Penny and Evangeline Mary, and divorced in 1949.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,309_6,"Did Viola Liuzzo have any children with her second husband, George Argyris?","Viola Liuzzo had two children with her second husband, George Argyris.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,309_6,"Did Viola Liuzzo have any children with her second husband, George Argyris?","Viola Liuzzo had two children with her second husband, George Argyris.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,309_6,"Did Viola Liuzzo have any children with her second husband, George Argyris?","George Argyris and Viola Liuzzo had two children, Penny and Evangeline Mary, and divorced in 1949.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
66,309_6,"Did Viola Liuzzo have any children with her second husband, George Argyris?","George Argyris and Viola Liuzzo had two children, Penny and Evangeline Mary, and divorced in 1949.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,31_1,What is throat cancer?,Throat cancer is a cancer of the throat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,good,false,false,,
48,31_1,What is throat cancer?,Throat cancer is a cancer of the throat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,31_1,What is throat cancer?,Two categories of throat cancer are: Pharyngeal cancer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
8,31_1,What is throat cancer?,Two categories of throat cancer are: Pharyngeal cancer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
8,31_1,What is throat cancer?,Throat cancer is a form of throat cancer.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,correct answer,
29,31_1,What is throat cancer?,Throat cancer is a form of throat cancer.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,true,false,correct answer,
35,31_1,What is throat cancer?,"Throat cancer refers to cancer of the voice box, the vocal cords, and other parts of the throat, such as the tonsils and oropharynx.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,31_1,What is throat cancer?,"Throat cancer refers to cancer of the voice box, the vocal cords, and other parts of the throat, such as the tonsils and oropharynx.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
55,31_1,What is throat cancer?,Throat cancer is a class of diseases in which abnormal cells multiply and divide uncontrollably in the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
41,31_1,What is throat cancer?,Throat cancer is a class of diseases in which abnormal cells multiply and divide uncontrollably in the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,good,false,false,,
16,31_1,What is throat cancer?,Throat cancer is a type of cancer that starts in the throat.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
24,31_1,What is throat cancer?,Throat cancer is a type of cancer that starts in the throat.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
20,31_1,What is throat cancer?,throat cancer is a cancer that can occur in combination of the following types,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
54,31_1,What is throat cancer?,throat cancer is a cancer that can occur in combination of the following types,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
9,31_3,Tell me about lung cancer.,"Lung cancer, by the name, is cancer that starts in the lungs.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
15,31_3,Tell me about lung cancer.,"Lung cancer, by the name, is cancer that starts in the lungs.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,nice,false,false,confusing answer,
9,31_3,Tell me about lung cancer.,A lung cancer is a type of cancer that develops in the lining of the small blood vessels that carry oxygen and nutrients from the lungs to the rest of the body.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,31_3,Tell me about lung cancer.,A lung cancer is a type of cancer that develops in the lining of the small blood vessels that carry oxygen and nutrients from the lungs to the rest of the body.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,very nice,false,false,correct answer,
67,31_3,Tell me about lung cancer.,Lung cancer is a type of cancer that starts in the lungs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
30,31_3,Tell me about lung cancer.,Lung cancer is a type of cancer that starts in the lungs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
23,31_4,What are lung cancer's symptoms?,"The most common symptoms of lung cancer are a persistent cough, wheezing, and difficulty breathing.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,31_4,What are lung cancer's symptoms?,"The most common symptoms of lung cancer are a persistent cough, wheezing, and difficulty breathing.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,31_4,What are lung cancer's symptoms?,"Symptoms of lung cancer include coughing up blood, shortness of breath, and weight loss.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,31_4,What are lung cancer's symptoms?,"Symptoms of lung cancer include coughing up blood, shortness of breath, and weight loss.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,31_4,What are lung cancer's symptoms?,"Symptoms of lung cancer include coughing, wheezing, chest pain, and chest tightness.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
52,31_4,What are lung cancer's symptoms?,"Symptoms of lung cancer include coughing, wheezing, chest pain, and chest tightness.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
98,31_4,What are lung cancer's symptoms?,"The specific symptoms of lung cancer include significant dyspnea or shortness of breath, hemoptysis, or coughing up blood, chronic cough, wheezing, chest pain or abdominal pain, weight loss, fatigue and difficulty swallowing lung cancer symptoms in women.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,31_4,What are lung cancer's symptoms?,"The specific symptoms of lung cancer include significant dyspnea or shortness of breath, hemoptysis, or coughing up blood, chronic cough, wheezing, chest pain or abdominal pain, weight loss, fatigue and difficulty swallowing lung cancer symptoms in women.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,31_7,What is the first sign of throat cancer?,Early signs of throat cancer may include: Hoarseness or other change in the voice.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,31_7,What is the first sign of throat cancer?,Early signs of throat cancer may include: Hoarseness or other change in the voice.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,31_7,What is the first sign of throat cancer?,"Signs and symptoms of throat cancer may include: A cough. Changes in your voice, such as hoarseness or not speaking clearly. Ear pain. A lump or sore throat that doesn't heal.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,31_7,What is the first sign of throat cancer?,"Signs and symptoms of throat cancer may include: A cough. Changes in your voice, such as hoarseness or not speaking clearly. Ear pain. A lump or sore throat that doesn't heal.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,31_7,What is the first sign of throat cancer?,The first sign of throat cancer is a cough.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,31_7,What is the first sign of throat cancer?,The first sign of throat cancer is a cough.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
44,31_7,What is the first sign of throat cancer?,The first sign of throat cancer is a persistent cough.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
36,31_7,What is the first sign of throat cancer?,The first sign of throat cancer is a persistent cough.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,31_7,What is the first sign of throat cancer?,Early signs of throat cancer may include: Hoarseness or other change in the voice Difficulty swallowing or the feeling that something is caught in the throat Persistent sore throat Ear pain Lump in the neck Cough Breathing problems Unexplained weight loss These symptoms do not always mean you have throat cancer.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
13,31_7,What is the first sign of throat cancer?,Early signs of throat cancer may include: Hoarseness or other change in the voice Difficulty swallowing or the feeling that something is caught in the throat Persistent sore throat Ear pain Lump in the neck Cough Breathing problems Unexplained weight loss These symptoms do not always mean you have throat cancer.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
6,31_7,What is the first sign of throat cancer?,The very first signs of throat cancer may include: Hoarseness or other change in the voice Difficulty swallowing or the feeling that something is caught in the throat.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,31_7,What is the first sign of throat cancer?,The very first signs of throat cancer may include: Hoarseness or other change in the voice Difficulty swallowing or the feeling that something is caught in the throat.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
103,31_7,What is the first sign of throat cancer?,The first sign of throat cancer is a lump in the throat.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,31_7,What is the first sign of throat cancer?,The first sign of throat cancer is a lump in the throat.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
31,31_7,What is the first sign of throat cancer?,the first signs of throat cancer may be a cough. a lump or sore that,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
9,31_7,What is the first sign of throat cancer?,the first signs of throat cancer may be a cough. a lump or sore that,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
15,316_3,Did the critic Robert Hughes and Danne Emerson have any children?,Robert Hughes and Dan Emerson had two children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,316_3,Did the critic Robert Hughes and Danne Emerson have any children?,Robert Hughes and Dan Emerson had two children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
19,316_3,Did the critic Robert Hughes and Danne Emerson have any children?,Robert Hughes and Danne Emerson had two children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
31,316_3,Did the critic Robert Hughes and Danne Emerson have any children?,Robert Hughes and Danne Emerson had two children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
3,316_3,Did the critic Robert Hughes and Danne Emerson have any children?,Robert Hughes and Danne Emerson's only child was born in 1981.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,316_3,Did the critic Robert Hughes and Danne Emerson have any children?,Robert Hughes and Danne Emerson's only child was born in 1981.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Dan Emerson were divorced in 1981.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
61,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Dan Emerson were divorced in 1981.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson got a divorce in 1991.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson got a divorce in 1991.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson divorced in 1981; she died of a brain tumour in 2003.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson divorced in 1981; she died of a brain tumour in 2003.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson got a divorce in 1981,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson got a divorce in 1981,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Dan Emerson were divorced in 1992.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Dan Emerson were divorced in 1992.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson divorced in 1981.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,316_5,When did the critic Robert Hughes and Danne Emerson get a divorce?,Robert Hughes and Danne Emerson divorced in 1981.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
7,318_4,"What happened at Solange Knowles' party held on October 24, 2012?","On October 24, 2012, Knowles held a listening party in New York City for her EP True.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,318_4,"What happened at Solange Knowles' party held on October 24, 2012?","On October 24, 2012, Knowles held a listening party in New York City for her EP True.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
16,318_4,"What happened at Solange Knowles' party held on October 24, 2012?","Solange Knowles held a listening party in New York City for her EP True, released for digital download on iTunes November 27, 2012.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
54,318_4,"What happened at Solange Knowles' party held on October 24, 2012?","Solange Knowles held a listening party in New York City for her EP True, released for digital download on iTunes November 27, 2012.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,318_4,"What happened at Solange Knowles' party held on October 24, 2012?","knowles held a listening party in new york city for her ep true, released for digital download on itunes november 27, 2012. [ 57 ] the cd and vinyl was made available january 8",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
12,318_4,"What happened at Solange Knowles' party held on October 24, 2012?","knowles held a listening party in new york city for her ep true, released for digital download on itunes november 27, 2012. [ 57 ] the cd and vinyl was made available january 8",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
10,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon cephalopods and bony fish including mackerels, tunas, bonitos, and swordfish.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,good,false,false,,
38,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon cephalopods and bony fish including mackerels, tunas, bonitos, and swordfish.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,true,false,random answer,
45,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon cephalopods and bony fish including swordfish, mackerels, Isolas, swordfish, and swordfish, but it may also eat other sharks, porpoises, sea turtles, and seabirds.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
25,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon cephalopods and bony fish including swordfish, mackerels, Isolas, swordfish, and swordfish, but it may also eat other sharks, porpoises, sea turtles, and seabirds.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
53,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon other cephalopods and bony fish including mackerels, tunas, and porpoises.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon other cephalopods and bony fish including mackerels, tunas, and porpoises.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
17,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon cephalopods and bony fish including mackerels, tunas, swordfish, and marlin, but it may also eat other sharks, porpoises, sea turtles, and seabirds.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
50,32_10,What do Mako sharks eat?,"The shortfin mako shark feeds mainly upon cephalopods and bony fish including mackerels, tunas, swordfish, and marlin, but it may also eat other sharks, porpoises, sea turtles, and seabirds.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
10,32_10,What do Mako sharks eat?,"Mako shark feeds on fish such as snapper, grouper and drum.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,32_10,What do Mako sharks eat?,"Mako shark feeds on fish such as snapper, grouper and drum.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
30,32_10,What do Mako sharks eat?,The shortfin mako shark feeds mainly upon bronze cephalopods and bony fish.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
87,32_10,What do Mako sharks eat?,The shortfin mako shark feeds mainly upon bronze cephalopods and bony fish.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
45,32_10,What do Mako sharks eat?,"The mako's diet consists mainly of sharks, swordfish, and tarpon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
56,32_10,What do Mako sharks eat?,"The mako's diet consists mainly of sharks, swordfish, and tarpon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
111,32_4,What is the largest shark ever to have lived on Earth?,The Megalodon is the world's largest known shark.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
7,32_4,What is the largest shark ever to have lived on Earth?,The Megalodon is the world's largest known shark.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
32,32_4,What is the largest shark ever to have lived on Earth?,"The largest shark ever to have lived on Earth is the Megalodon, a fish species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
19,32_4,What is the largest shark ever to have lived on Earth?,"The largest shark ever to have lived on Earth is the Megalodon, a fish species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,32_4,What is the largest shark ever to have lived on Earth?,"The Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,32_4,What is the largest shark ever to have lived on Earth?,"The Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,random answer,
4,32_4,What is the largest shark ever to have lived on Earth?,"The largest known shark to have lived on Earth is the Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
38,32_4,What is the largest shark ever to have lived on Earth?,"The largest known shark to have lived on Earth is the Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
7,32_4,What is the largest shark ever to have lived on Earth?,"The largest fish ever to have lived on Earth is the Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,32_4,What is the largest shark ever to have lived on Earth?,"The largest fish ever to have lived on Earth is the Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,32_4,What is the largest shark ever to have lived on Earth?,The largest ever to have lived on Earth was the megalodon. It was a shark that lived about 2.6 million years ago.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,32_4,What is the largest shark ever to have lived on Earth?,The largest ever to have lived on Earth was the megalodon. It was a shark that lived about 2.6 million years ago.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
34,32_4,What is the largest shark ever to have lived on Earth?,"The largest shark ever to have lived on Earth is the Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
22,32_4,What is the largest shark ever to have lived on Earth?,"The largest shark ever to have lived on Earth is the Megalodon, an extinct shark species believed to be the largest fish on planet Earth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
51,32_5,What's the biggest shark ever caught?,The largest shark ever caught was a great white shark that was caught and released off the coast of Great Britain in 1960.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
32,32_5,What's the biggest shark ever caught?,The largest shark ever caught was a great white shark that was caught and released off the coast of Great Britain in 1960.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
16,32_5,What's the biggest shark ever caught?,The largest shark ever caught was a great white shark that was caught off the coast of Great Britain in 1960.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
8,32_5,What's the biggest shark ever caught?,The largest shark ever caught was a great white shark that was caught off the coast of Great Britain in 1960.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
9,32_5,What's the biggest shark ever caught?,The largest shark ever caught was the Great White Shark.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
18,32_5,What's the biggest shark ever caught?,The largest shark ever caught was the Great White Shark.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,32_5,What's the biggest shark ever caught?,The biggest shark ever caught was a great white shark.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,32_5,What's the biggest shark ever caught?,The biggest shark ever caught was a great white shark.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
32,32_5,What's the biggest shark ever caught?,"The largest shark ever caught was a great white shark that was 21 feet long and weighed 1,323 pounds.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
101,32_5,What's the biggest shark ever caught?,"The largest shark ever caught was a great white shark that was 21 feet long and weighed 1,323 pounds.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,random answer,
8,322_3,Where did Tab Hunter's Ninety-Nine Ways land on the charts?,Tab Hunter's ninety-nine Ways reached number one on the Billboard Hot 100.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,322_3,Where did Tab Hunter's Ninety-Nine Ways land on the charts?,Tab Hunter's ninety-nine Ways reached number one on the Billboard Hot 100.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,322_3,Where did Tab Hunter's Ninety-Nine Ways land on the charts?,Tab Hunter's Ninety-Nine Ways charted on the Billboard Hot 100.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,322_3,Where did Tab Hunter's Ninety-Nine Ways land on the charts?,Tab Hunter's Ninety-Nine Ways charted on the Billboard Hot 100.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
51,322_3,Where did Tab Hunter's Ninety-Nine Ways land on the charts?,Tab Hunter's Ninety-Nine Ways landed on the Billboard Hot 100.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
23,322_3,Where did Tab Hunter's Ninety-Nine Ways land on the charts?,Tab Hunter's Ninety-Nine Ways landed on the Billboard Hot 100.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
3,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,"Other programs initiated by Gavin Newsom to end chronic homelessness include the San Francisco Homeless Outreach Team (SF HOT), and Project Homeless Connect (PHC).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,"Other programs initiated by Gavin Newsom to end chronic homelessness include the San Francisco Homeless Outreach Team (SF HOT), and Project Homeless Connect (PHC).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,"Other programs initiated by Newsom to end chronic homelessness include the San Francisco Homeless Outreach Team, and Project Homeless Connect.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
8,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,"Other programs initiated by Newsom to end chronic homelessness include the San Francisco Homeless Outreach Team, and Project Homeless Connect.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
14,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,other programs initiated by newsom to end chronic homelessness include the san francisco homeless outreach team ( sf hot ),rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
14,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,other programs initiated by newsom to end chronic homelessness include the san francisco homeless outreach team ( sf hot ),rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
6,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,"Other programs initiated by Gavin Newsom to end chronic homelessness include the San Francisco Homeless Outreach Team, and Project Homeless Connect.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,323_7,what are some of Gavin Newsom other programs besides the Care Not Cash initiative?,"Other programs initiated by Gavin Newsom to end chronic homelessness include the San Francisco Homeless Outreach Team, and Project Homeless Connect.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,324_4,What did Alia Bhatt do for PETA?,"In 2013, Alia Bhatt took part in a campaign for PETA to raise awareness on homeless animals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,324_4,What did Alia Bhatt do for PETA?,"In 2013, Alia Bhatt took part in a campaign for PETA to raise awareness on homeless animals.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
10,324_4,What did Alia Bhatt do for PETA?,Alia Bhatt took part in a campaign for PETA to raise awareness about the welfare of street animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
51,324_4,What did Alia Bhatt do for PETA?,Alia Bhatt took part in a campaign for PETA to raise awareness about the welfare of street animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,324_4,What did Alia Bhatt do for PETA?,Alia Bhatt took part in a campaign for PETA to raise awareness on homeless animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,324_4,What did Alia Bhatt do for PETA?,Alia Bhatt took part in a campaign for PETA to raise awareness on homeless animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,327_1,What sport did Virat Kohli play?,Virat Kohli is a cricketer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
20,327_1,What sport did Virat Kohli play?,Virat Kohli is a cricketer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,327_1,What sport did Virat Kohli play?,Kohli is an Indian cricketer who captained the Indian cricket team in one-day internationals (ODIs) and Twenty20 Internationals (T20Is).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
21,327_1,What sport did Virat Kohli play?,Kohli is an Indian cricketer who captained the Indian cricket team in one-day internationals (ODIs) and Twenty20 Internationals (T20Is).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
16,327_1,What sport did Virat Kohli play?,Kohli is an Indian cricketer.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,327_1,What sport did Virat Kohli play?,Kohli is an Indian cricketer.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,327_2,What position did Virat Kohli play in cricket?,Virat Kohli is a batsman.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,327_2,What position did Virat Kohli play in cricket?,Virat Kohli is a batsman.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,327_2,What position did Virat Kohli play in cricket?,Kohli is a naturally aggressive batsman with strong technical skills.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,327_2,What position did Virat Kohli play in cricket?,Kohli is a naturally aggressive batsman with strong technical skills.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,,
16,327_2,What position did Virat Kohli play in cricket?,Kohli was a right-handed top-order batsman.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,327_2,What position did Virat Kohli play in cricket?,Kohli was a right-handed top-order batsman.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is an Indian cricketer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is an Indian cricketer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is a cricketer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
3,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is a cricketer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is an Indian cricketer who played as an opening batsman for India.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is an Indian cricketer who played as an opening batsman for India.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is an Indian cricketer who played for the Indian cricket team.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,327_7,Who is Sachin Tendulkar?,Sachin Tendulkar is an Indian cricketer who played for the Indian cricket team.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,329_4,where would Cary Grant travel with the pender troupe?,Cary Grant would travel with the Pender troupe.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,329_4,where would Cary Grant travel with the pender troupe?,Cary Grant would travel with the Pender troupe.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,329_4,where would Cary Grant travel with the pender troupe?,Cary Grant traveled with the Pender troupe to New York City,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
15,329_4,where would Cary Grant travel with the pender troupe?,Cary Grant traveled with the Pender troupe to New York City,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,329_4,where would Cary Grant travel with the pender troupe?,"At the age of 16, Cary Grant went as a stage performer with the Penders for a tour of the US.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,329_4,where would Cary Grant travel with the pender troupe?,"At the age of 16, Cary Grant went as a stage performer with the Penders for a tour of the US.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,33_10,Did the horse Artax really die?,"Contrary to an Internet rumor, the horse that played Artax did not really die during the filming of the Swamp of Doom scene.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
55,33_10,Did the horse Artax really die?,"Contrary to an Internet rumor, the horse that played Artax did not really die during the filming of the Swamp of Doom scene.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
63,33_10,Did the horse Artax really die?,"Contrary to an Internet rumor, the horse that played Artax did not really die during the filming of the Swamp of Sadness scene.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,33_10,Did the horse Artax really die?,"Contrary to an Internet rumor, the horse that played Artax did not really die during the filming of the Swamp of Sadness scene.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,33_10,Did the horse Artax really die?,the horse that played artax did not really die during the filming of the swamp of sadness scene,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,33_10,Did the horse Artax really die?,the horse that played artax did not really die during the filming of the swamp of sadness scene,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,VERY NICE,false,false,,
16,330_2,What does the band name Day26 mean?,The band name Day26 is a play on words day and 26.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,330_2,What does the band name Day26 mean?,The band name Day26 is a play on words day and 26.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,330_2,What does the band name Day26 mean?,The band name Day26 is a play on words for the number 26.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,330_2,What does the band name Day26 mean?,The band name Day26 is a play on words for the number 26.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,330_2,What does the band name Day26 mean?,the name day 26 was selected from the day that they were picked which was august 26,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
80,330_2,What does the band name Day26 mean?,the name day 26 was selected from the day that they were picked which was august 26,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
19,330_2,What does the band name Day26 mean?,"The name Day 26 was selected from the day that they were picked which was August 26, 2007.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,330_2,What does the band name Day26 mean?,"The name Day 26 was selected from the day that they were picked which was August 26, 2007.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
32,330_4,Did the band day26 have any number one hits?,"Day26's first single, I Am 26 reached number one on the Billboard Hot 100.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,330_4,Did the band day26 have any number one hits?,"Day26's first single, I Am 26 reached number one on the Billboard Hot 100.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
20,330_4,Did the band day26 have any number one hits?,"Day26's first single, Got Me Going, went on to debut at number one on the Billboard Hot 100.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,330_4,Did the band day26 have any number one hits?,"Day26's first single, Got Me Going, went on to debut at number one on the Billboard Hot 100.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
32,330_4,Did the band day26 have any number one hits?,"The album Day26's first single, Got Me Going went on to debut at number one on the Billboard charts.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,330_4,Did the band day26 have any number one hits?,"The album Day26's first single, Got Me Going went on to debut at number one on the Billboard charts.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,331_1,what is the Tragically Hip?,The Tragically Hip is an American rock band.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,331_1,what is the Tragically Hip?,The Tragically Hip is an American rock band.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
31,331_1,what is the Tragically Hip?,"The Tragically Hip is a Canadian rock band from Kingston, Ontario.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,331_1,what is the Tragically Hip?,"The Tragically Hip is a Canadian rock band from Kingston, Ontario.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
25,331_1,what is the Tragically Hip?,"The Tragically Hip is an English rock band from Kingston, Ontario, Canada.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
106,331_1,what is the Tragically Hip?,"The Tragically Hip is an English rock band from Kingston, Ontario, Canada.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,331_1,what is the Tragically Hip?,The Tragically Hip is a Canadian rock band.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
3,331_1,what is the Tragically Hip?,The Tragically Hip is a Canadian rock band.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,331_1,what is the Tragically Hip?,"The Tragically Hip is a Canadian rock band. Formed in Kingston, Ontario, in the mid-1970s, the band was fronted by Gord Downie.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
5,331_1,what is the Tragically Hip?,"The Tragically Hip is a Canadian rock band. Formed in Kingston, Ontario, in the mid-1970s, the band was fronted by Gord Downie.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
56,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip's sixth album, Phantom Power, was released in 1998",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip's sixth album, Phantom Power, was released in 1998",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip released their sixth studio album, Phantom Power, on July 14, 1998.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip released their sixth studio album, Phantom Power, on July 14, 1998.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip's sixth studio album, Phantom Power, was released in 1998",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
65,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip's sixth studio album, Phantom Power, was released in 1998",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip's sixth studio album, Phantom Power, was released in 1998. It won the 1999 Juno Awards for Best Rock Album and Best Album Design.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,331_2,what happened to the canadian rock band the tragically hip  in 1998?,"The Tragically Hip's sixth studio album, Phantom Power, was released in 1998. It won the 1999 Juno Awards for Best Rock Album and Best Album Design.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,336_4,Did Andrew Johnson have any siblings?,"Andrew Johnson had a brother William, four years his senior.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,336_4,Did Andrew Johnson have any siblings?,"Andrew Johnson had a brother William, four years his senior.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,336_4,Did Andrew Johnson have any siblings?,"Andrew Johnson had a brother William, four years his senior, and an older sister Elizabeth, who died in childhood.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,336_4,Did Andrew Johnson have any siblings?,"Andrew Johnson had a brother William, four years his senior, and an older sister Elizabeth, who died in childhood.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
21,336_4,Did Andrew Johnson have any siblings?,"Andrew Johnson had a brother William Hathaway, four years his senior, and an older sister Elizabeth, who died in childhood.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,336_4,Did Andrew Johnson have any siblings?,"Andrew Johnson had a brother William Hathaway, four years his senior, and an older sister Elizabeth, who died in childhood.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,337_6,Did Eddie Rabbitt have a lot of albums?,Eddie Rabbitt released four studio albums.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,337_6,Did Eddie Rabbitt have a lot of albums?,Eddie Rabbitt released four studio albums.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,337_6,Did Eddie Rabbitt have a lot of albums?,Eddie Rabbitt has 15 studio albums.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,337_6,Did Eddie Rabbitt have a lot of albums?,Eddie Rabbitt has 15 studio albums.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,337_6,Did Eddie Rabbitt have a lot of albums?,Eddie Rabbitt's discography consists of 15 albums.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,337_6,Did Eddie Rabbitt have a lot of albums?,Eddie Rabbitt's discography consists of 15 albums.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,338_10,Did the production of Fiddler on the Roof win any awards?,Fiddler on the Roof won the Tony Award for Best Musical.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,338_10,Did the production of Fiddler on the Roof win any awards?,Fiddler on the Roof won the Tony Award for Best Musical.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
20,338_10,Did the production of Fiddler on the Roof win any awards?,"Fiddler on the Roof was nominated for ten Tony Awards, winning nine, including Best Musical, score, and book, and Robbins won for best direction and choreography.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,338_10,Did the production of Fiddler on the Roof win any awards?,"Fiddler on the Roof was nominated for ten Tony Awards, winning nine, including Best Musical, score, and book, and Robbins won for best direction and choreography.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,338_10,Did the production of Fiddler on the Roof win any awards?,"Fiddler on the Roof won 10 Tony Awards, including a special Tony for becoming the longest-running Broadway musical of all time.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,338_10,Did the production of Fiddler on the Roof win any awards?,"Fiddler on the Roof won 10 Tony Awards, including a special Tony for becoming the longest-running Broadway musical of all time.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,338_2,What city was the Imperial Theatre in?,"The Imperial Theatre is a production theatre located at 249 West 45th Street in Manhattan, New York City.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,338_2,What city was the Imperial Theatre in?,"The Imperial Theatre is a production theatre located at 249 West 45th Street in Manhattan, New York City.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,338_2,What city was the Imperial Theatre in?,"The Imperial Theatre was located at 249 West 45th Street in midtown Manhattan, New York City.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,338_2,What city was the Imperial Theatre in?,"The Imperial Theatre was located at 249 West 45th Street in midtown Manhattan, New York City.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,338_2,What city was the Imperial Theatre in?,The Imperial Theatre is a Broadway theatre located at 249 West 45th Street (George Abbott Way) in midtown- Manhattan.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,338_2,What city was the Imperial Theatre in?,The Imperial Theatre is a Broadway theatre located at 249 West 45th Street (George Abbott Way) in midtown- Manhattan.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,34_1,Tell me about the Bronze Age collapse.,The Bronze Age collapse is so called by historians who study the end of the Bronze Age.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
5,34_1,Tell me about the Bronze Age collapse.,The Bronze Age collapse is so called by historians who study the end of the Bronze Age.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
38,34_1,Tell me about the Bronze Age collapse.,The Bronze Age was a period of pre-Columbian history characterized by the collapse of the Iron Age.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,confusing answer,
84,34_1,Tell me about the Bronze Age collapse.,The Bronze Age was a period of pre-Columbian history characterized by the collapse of the Iron Age.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,confusing answer,
26,34_1,Tell me about the Bronze Age collapse.,The Bronze Age collapse was a period of time in the history of the world when the Bronze Age came to an end.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
90,34_1,Tell me about the Bronze Age collapse.,The Bronze Age collapse was a period of time in the history of the world when the Bronze Age came to an end.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
78,34_1,Tell me about the Bronze Age collapse.,The Bronze Age collapse is a period in the history of the Roman Empire that began in the 4th century BC.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,true,false,random answer,
26,34_1,Tell me about the Bronze Age collapse.,The Bronze Age collapse is a period in the history of the Roman Empire that began in the 4th century BC.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,34_1,Tell me about the Bronze Age collapse.,"The Bronze Age collapse was due to prolonged drought. This caused waves of refugees and invasions (Sea people) of desperate people that collapsed trade (no more tin+copper, no more bronze for weapons and plows) and with it the collapse of the Ancient states with the exception of a weakened Egypt.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
51,34_1,Tell me about the Bronze Age collapse.,"The Bronze Age collapse was due to prolonged drought. This caused waves of refugees and invasions (Sea people) of desperate people that collapsed trade (no more tin+copper, no more bronze for weapons and plows) and with it the collapse of the Ancient states with the exception of a weakened Egypt.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,good,false,false,,
57,34_1,Tell me about the Bronze Age collapse.,The Bronze Age was a period of time during which many of the world's pre-eminent civilizations collapsed.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,34_1,Tell me about the Bronze Age collapse.,The Bronze Age was a period of time during which many of the world's pre-eminent civilizations collapsed.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,very nice,false,false,,
42,34_5,What was the Sea Peoples role in the Bronze Age collapse?,The Sea Peoples are a purported seafaring confederation that attacked ancient Egypt and other regions of the East Mediterranean prior to and during the Late Bronze Age collapse.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,34_5,What was the Sea Peoples role in the Bronze Age collapse?,The Sea Peoples are a purported seafaring confederation that attacked ancient Egypt and other regions of the East Mediterranean prior to and during the Late Bronze Age collapse.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,positive one,false,false,,
39,34_5,What was the Sea Peoples role in the Bronze Age collapse?,The Sea Peoples were a group of people who lived in the Mediterranean Sea during the Late Bronze Age.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
108,34_5,What was the Sea Peoples role in the Bronze Age collapse?,The Sea Peoples were a group of people who lived in the Mediterranean Sea during the Late Bronze Age.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,34_5,What was the Sea Peoples role in the Bronze Age collapse?,"The Sea Peoples, a range of groups including the Philistines, led raids on the Eastern Mediterranean during the period of the Bronze Age collapse and are often cited as the reason for the collapse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,34_5,What was the Sea Peoples role in the Bronze Age collapse?,"The Sea Peoples, a range of groups including the Philistines, led raids on the Eastern Mediterranean during the period of the Bronze Age collapse and are often cited as the reason for the collapse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,340_1,What type of music did Bill Monroe originally play?,Bill Monroe originally played country music.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
19,340_1,What type of music did Bill Monroe originally play?,Bill Monroe originally played country music.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,340_1,What type of music did Bill Monroe originally play?,Bill Monroe originally played bluegrass music.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,340_1,What type of music did Bill Monroe originally play?,Bill Monroe originally played bluegrass music.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
32,340_1,What type of music did Bill Monroe originally play?,"Bill Monroe's music was primarily influenced by blues, bluegrass, and rock 'n' roll.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,340_1,What type of music did Bill Monroe originally play?,"Bill Monroe's music was primarily influenced by blues, bluegrass, and rock 'n' roll.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,340_2,WHat type of music was Bill Monroe known for (famous for)?,Monroe was known for bluegrass music.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,340_2,WHat type of music was Bill Monroe known for (famous for)?,Monroe was known for bluegrass music.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
16,340_2,WHat type of music was Bill Monroe known for (famous for)?,Bill Monroe was known for his bluegrass.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,340_2,WHat type of music was Bill Monroe known for (famous for)?,Bill Monroe was known for his bluegrass.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,340_2,WHat type of music was Bill Monroe known for (famous for)?,Bill Monroe was known for (famous for) bluegrass,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,340_2,WHat type of music was Bill Monroe known for (famous for)?,Bill Monroe was known for (famous for) bluegrass,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
20,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Monroe successfully auditioned for a regular spot on the Grand Ole Opry, impressing Opry founder George D. Hay with his energetic performance of Jimmie Rodgers's Mule Blues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
41,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Monroe successfully auditioned for a regular spot on the Grand Ole Opry, impressing Opry founder George D. Hay with his energetic performance of Jimmie Rodgers's Mule Blues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Monroe successfully auditioned for a regular spot on the Grand Ole Opry, and Opry founder George D. Hay with his energetic performance of Jimmie Rodgers' Mule Blues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Monroe successfully auditioned for a regular spot on the Grand Ole Opry, and Opry founder George D. Hay with his energetic performance of Jimmie Rodgers' Mule Blues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Bill Monroe successfully auditioned for a regular spot on the Grand Ole Opry.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
10,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Bill Monroe successfully auditioned for a regular spot on the Grand Ole Opry.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,,
9,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Bill Monroe successfully auditioned for a regular spot on the Grand Ole Opry, impressing Opry founder George D. Hay with his energetic performance of Jimmie Rodgers's Mule Blues",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Bill Monroe successfully auditioned for a regular spot on the Grand Ole Opry, impressing Opry founder George D. Hay with his energetic performance of Jimmie Rodgers's Mule Blues",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
25,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Monroe successfully auditioned for a regular spot on the Grand Ole Opry, fiddler George D. Hay with his energetic performance of Jimmie Rodgers' Mule Blues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
5,340_5,DId Bill Monroe play an instrument or sing in the Grad Ole Opry?,"In October 1939, Monroe successfully auditioned for a regular spot on the Grand Ole Opry, fiddler George D. Hay with his energetic performance of Jimmie Rodgers' Mule Blues.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
19,340_6,Did Bill Monroe perform in any bands?,Bill Monroe joined the Blue Grass Boys in 1942.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,340_6,Did Bill Monroe perform in any bands?,Bill Monroe joined the Blue Grass Boys in 1942.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
18,340_6,Did Bill Monroe perform in any bands?,More than 150 musicians played in the Blue Grass Boys over the nearly 60 years of Monroe's performing career.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
20,340_6,Did Bill Monroe perform in any bands?,More than 150 musicians played in the Blue Grass Boys over the nearly 60 years of Monroe's performing career.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
19,340_6,Did Bill Monroe perform in any bands?,Bill Monroe was a founding member of the bluegrass band the Blue Grass Boys.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,340_6,Did Bill Monroe perform in any bands?,Bill Monroe was a founding member of the bluegrass band the Blue Grass Boys.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,340_6,Did Bill Monroe perform in any bands?,Bill Monroe performed in the Blue Grass Boys.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
13,340_6,Did Bill Monroe perform in any bands?,Bill Monroe performed in the Blue Grass Boys.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
23,340_6,Did Bill Monroe perform in any bands?,More than 150 musicians played in the Blue Grass Boys over the nearly 60 years of Bill Monroe's performing career.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
5,340_6,Did Bill Monroe perform in any bands?,More than 150 musicians played in the Blue Grass Boys over the nearly 60 years of Bill Monroe's performing career.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,341_3,Did Tommy Hilfiger have a foundation?,Tommy Hilfiger has established the Tommy Hilfiger Foundation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,341_3,Did Tommy Hilfiger have a foundation?,Tommy Hilfiger has established the Tommy Hilfiger Foundation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,341_3,Did Tommy Hilfiger have a foundation?,Tommy Hilfiger has a foundation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
26,341_3,Did Tommy Hilfiger have a foundation?,Tommy Hilfiger has a foundation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,"It doesn't state what the foundation is, but it does answer the question.",false,false,,
18,341_3,Did Tommy Hilfiger have a foundation?,In 1995 Tommy Hilfiger launched The Tommy Hilfiger Corporate Foundation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
8,341_3,Did Tommy Hilfiger have a foundation?,In 1995 Tommy Hilfiger launched The Tommy Hilfiger Corporate Foundation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,341_3,Did Tommy Hilfiger have a foundation?,"Tommy Hilfiger launched The Tommy Hilfiger Corporate Foundation. With an emphasis on health, educational and cultural programs, the organization supports charities that focus on at-risk American youth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,341_3,Did Tommy Hilfiger have a foundation?,"Tommy Hilfiger launched The Tommy Hilfiger Corporate Foundation. With an emphasis on health, educational and cultural programs, the organization supports charities that focus on at-risk American youth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,341_3,Did Tommy Hilfiger have a foundation?,"In 1995 Tommy Hilfiger launched The Tommy Hilfiger Corporate Foundation. With an emphasis on health, educational and cultural programs, the organization supports charities that focus on-risk American youth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
8,341_3,Did Tommy Hilfiger have a foundation?,"In 1995 Tommy Hilfiger launched The Tommy Hilfiger Corporate Foundation. With an emphasis on health, educational and cultural programs, the organization supports charities that focus on-risk American youth.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,341_3,Did Tommy Hilfiger have a foundation?,The Tommy Hilfiger Foundation is a non-profit organization established by Tommy Hilfiger,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,341_3,Did Tommy Hilfiger have a foundation?,The Tommy Hilfiger Foundation is a non-profit organization established by Tommy Hilfiger,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,341_3,Did Tommy Hilfiger have a foundation?,The Tommy Hilfiger Foundation is an umbrella organization for Hilfiger's philanthropic endeavors.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,341_3,Did Tommy Hilfiger have a foundation?,The Tommy Hilfiger Foundation is an umbrella organization for Hilfiger's philanthropic endeavors.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,346_1,In what films did Tod Browning appear?,Tod Browning's first film as a director was Silent Jim Bludso.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,346_1,In what films did Tod Browning appear?,Tod Browning's first film as a director was Silent Jim Bludso.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
13,346_1,In what films did Tod Browning appear?,Tod Browning's first feature film as a director was Silent Jim Bludso.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,346_1,In what films did Tod Browning appear?,Tod Browning's first feature film as a director was Silent Jim Bludso.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
32,346_1,In what films did Tod Browning appear?,Jim Bludso is a 1917 American drama film directed by Tod Browning.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,true,false,,
6,346_1,In what films did Tod Browning appear?,Jim Bludso is a 1917 American drama film directed by Tod Browning.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
21,347_1,What is the Breton language?,The Breton language is the spoken language in Breton. It is also the spoken language in Breton.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
7,347_1,What is the Breton language?,The Breton language is the spoken language in Breton. It is also the spoken language in Breton.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
13,347_1,What is the Breton language?,Breton is a Celtic language spoken in the Brittany region of western France.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
73,347_1,What is the Breton language?,Breton is a Celtic language spoken in the Brittany region of western France.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,347_1,What is the Breton language?,"The main traditional language of Brittany is Breton, spoken in Lower Brittany (i.e. the western part of the peninsula).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,347_1,What is the Breton language?,"The main traditional language of Brittany is Breton, spoken in Lower Brittany (i.e. the western part of the peninsula).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,347_1,What is the Breton language?," Breton is a Celtic language spoken in Brittany, France.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,347_1,What is the Breton language?," Breton is a Celtic language spoken in Brittany, France.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
17,347_1,What is the Breton language?,The Breton language is a French language.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,347_1,What is the Breton language?,The Breton language is a French language.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,347_1,What is the Breton language?,The Breton language is a Celtic language native to historical region Brittany.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
24,347_1,What is the Breton language?,The Breton language is a Celtic language native to historical region Brittany.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,347_4,Is Breton language taught in schools?,The Breton language is taught in schools.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,347_4,Is Breton language taught in schools?,The Breton language is taught in schools.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,347_4,Is Breton language taught in schools?,Breton is taught in schools.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,347_4,Is Breton language taught in schools?,Breton is taught in schools.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,347_4,Is Breton language taught in schools?,"In modern times, a number of schools and colleges have emerged with the aim of providing Breton-medium education or bilingual Breton/French education.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,347_4,Is Breton language taught in schools?,"In modern times, a number of schools and colleges have emerged with the aim of providing Breton-medium education or bilingual Breton/French education.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
30,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,Funny How Sweet Co-Co Can Be was not a serious contender on the charts.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
16,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,Funny How Sweet Co-Co Can Be was not a serious contender on the charts.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
22,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,The Sweet's album Funny How Sweet Co-Co Can Be was a commercial success.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,The Sweet's album Funny How Sweet Co-Co Can Be was a commercial success.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,The Sweet's album Funny How Sweet Co-Co Can Be went to No. 3 in the UK and peaked at No. 4 in the U.S.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
31,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,The Sweet's album Funny How Sweet Co-Co Can Be went to No. 3 in the UK and peaked at No. 4 in the U.S.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,The Sweet's album Funny How Sweet Co-Co Can Be failed to match the success of their previous recordings.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
22,350_2,Did The Sweet's album Funny How Sweet Co-Co Can Be do well?,The Sweet's album Funny How Sweet Co-Co Can Be failed to match the success of their previous recordings.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered at the age of 12.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered at the age of 12.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
12,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered at age five.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered at age five.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered when he was 10 years old.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered when he was 10 years old.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered at the age of 15.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,352_7,At what age was Bobby Jones discovered?,Bobby Jones was discovered at the age of 15.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
23,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina in 1992.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
16,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina in 1992.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina from Boca Juniors in 1991 after finishing as top goal scorer in that summer's Copa América.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
3,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina from Boca Juniors in 1991 after finishing as top goal scorer in that summer's Copa América.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina from Boca Juniors in 1991 after finishing as top goal scorer in that summer’s Copa America.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina from Boca Juniors in 1991 after finishing as top goal scorer in that summer’s Copa America.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina from Boca Juniors in 1991,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta moved to Fiorentina from Boca Juniors in 1991,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
25,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta went to Fiorentina in the summer of 2000.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta went to Fiorentina in the summer of 2000.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta joined Fiorentina in the summer of 1995.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,353_1,When did Gabriel Batistuta go to Fiorentina?,Gabriel Batistuta joined Fiorentina in the summer of 1995.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,354_1,Did Kelly Clarkson write a Children's Book?,"Kelly Clarkson's first children's book, River Rose and the Magical Lullaby, was released in 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,354_1,Did Kelly Clarkson write a Children's Book?,"Kelly Clarkson's first children's book, River Rose and the Magical Lullaby, was released in 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,354_1,Did Kelly Clarkson write a Children's Book?,"Kelly Clarkson's first children's book, River Rose and the Magical Lullaby, was inspired by her two-year-old daughter, River Rose.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
101,354_1,Did Kelly Clarkson write a Children's Book?,"Kelly Clarkson's first children's book, River Rose and the Magical Lullaby, was inspired by her two-year-old daughter, River Rose.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
34,354_1,Did Kelly Clarkson write a Children's Book?,"Kelly Clarkson wrote the children's book, River Rose and the Magical Lullaby.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,354_1,Did Kelly Clarkson write a Children's Book?,"Kelly Clarkson wrote the children's book, River Rose and the Magical Lullaby.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,354_3,What is the Meaning of Life by Kelly Clarkson?,The Meaning of Life is Kelly Clarkson's third studio album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
23,354_3,What is the Meaning of Life by Kelly Clarkson?,The Meaning of Life is Kelly Clarkson's third studio album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,354_3,What is the Meaning of Life by Kelly Clarkson?,"Kelly Clarkson's third album, Meaning of Life, was released on 24 October 2017.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,354_3,What is the Meaning of Life by Kelly Clarkson?,"Kelly Clarkson's third album, Meaning of Life, was released on 24 October 2017.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,354_3,What is the Meaning of Life by Kelly Clarkson?,"Kelly Clarkson's third studio album, Meaning of Life, was released on October 26, 2017.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,354_3,What is the Meaning of Life by Kelly Clarkson?,"Kelly Clarkson's third studio album, Meaning of Life, was released on October 26, 2017.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,354_4,What did Kelly Clarkson do on The Voice?,Kelly Clarkson returned as a coach on the seventeenth season of The Voice.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
3,354_4,What did Kelly Clarkson do on The Voice?,Kelly Clarkson returned as a coach on the seventeenth season of The Voice.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
78,354_4,What did Kelly Clarkson do on The Voice?,Kelly Clarkson was a participant on the twelfth season of The Voice.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,354_4,What did Kelly Clarkson do on The Voice?,Kelly Clarkson was a participant on the twelfth season of The Voice.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,354_4,What did Kelly Clarkson do on The Voice?,Kelly Clarkson was a contestant on The Voice.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
65,354_4,What did Kelly Clarkson do on The Voice?,Kelly Clarkson was a contestant on The Voice.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
18,356_1,what was the fictional character Legion?,Legion is a fictional superhero appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,356_1,what was the fictional character Legion?,Legion is a fictional superhero appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,356_1,what was the fictional character Legion?,Legion is a fictional character appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,356_1,what was the fictional character Legion?,Legion is a fictional character appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,356_1,what was the fictional character Legion?," Legion was a fictional character from the ""X-Men"" comics.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,356_1,what was the fictional character Legion?," Legion was a fictional character from the ""X-Men"" comics.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,357_1,When did Johnny Unitas get drafted into the Colts?,Johnny Unitas was drafted by the Colts in the first round of the 1967 NFL Draft.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,357_1,When did Johnny Unitas get drafted into the Colts?,Johnny Unitas was drafted by the Colts in the first round of the 1967 NFL Draft.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,357_1,When did Johnny Unitas get drafted into the Colts?,Johnny Unitas was drafted into the Colts in 1959.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
17,357_1,When did Johnny Unitas get drafted into the Colts?,Johnny Unitas was drafted into the Colts in 1959.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
16,357_1,When did Johnny Unitas get drafted into the Colts?,Johnny Unitas was drafted by the Colts in 1942.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,357_1,When did Johnny Unitas get drafted into the Colts?,Johnny Unitas was drafted by the Colts in 1942.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
2,358_1,Who is Olmec?,Olmec was a Mesoamerican civilization.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,358_1,Who is Olmec?,Olmec was a Mesoamerican civilization.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
23,358_1,Who is Olmec?,Olmec is a pre-Columbian Mesoamerican civilization in present-day Mexico.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,358_1,Who is Olmec?,Olmec is a pre-Columbian Mesoamerican civilization in present-day Mexico.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,358_1,Who is Olmec?,The Olmec civilization was a pre-Columbian pre-Columbian civilization that thrived in Central and South America between 1200 and 900 BCE.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
9,358_1,Who is Olmec?,The Olmec civilization was a pre-Columbian pre-Columbian civilization that thrived in Central and South America between 1200 and 900 BCE.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,358_1,Who is Olmec?,Olmec is the name of a Mesoamerican civilization that flourished in the area of modern-day Mexico from approximately 1200 BC to 400 BC.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,358_1,Who is Olmec?,Olmec is the name of a Mesoamerican civilization that flourished in the area of modern-day Mexico from approximately 1200 BC to 400 BC.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,358_1,Who is Olmec?,The Olmec civilization was one of the pre-Columbian civilizations of the Americas.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
12,358_1,Who is Olmec?,The Olmec civilization was one of the pre-Columbian civilizations of the Americas.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,358_1,Who is Olmec?,Olmec is the oldest known Mesoamerican civilization.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
32,358_1,Who is Olmec?,Olmec is the oldest known Mesoamerican civilization.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
5,359_1,What was Sheila E working on in 1984?,"Sheila E.'s second album, Sheila E.: The Glamorous Life, was released in 1984.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
22,359_1,What was Sheila E working on in 1984?,"Sheila E.'s second album, Sheila E.: The Glamorous Life, was released in 1984.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
28,359_1,What was Sheila E working on in 1984?," Sheila E was working on her album ""The Glamorous Life"" in 1984.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
3,359_1,What was Sheila E working on in 1984?," Sheila E was working on her album ""The Glamorous Life"" in 1984.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,359_1,What was Sheila E working on in 1984?,"Sheila E.'s 1984 album, The Glamorous Life, was produced by Robert Christgau.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,359_1,What was Sheila E working on in 1984?,"Sheila E.'s 1984 album, The Glamorous Life, was produced by Robert Christgau.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
36,36_1,What is the US Electoral College?,The Electoral College is the body that elects the president of the United States.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,36_1,What is the US Electoral College?,The Electoral College is the body that elects the president of the United States.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,good one,false,false,,
12,36_1,What is the US Electoral College?,The US Electoral College is a group of electors who vote for the president and vice president of the United States.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
27,36_1,What is the US Electoral College?,The US Electoral College is a group of electors who vote for the president and vice president of the United States.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,36_1,What is the US Electoral College?,The Electoral College is a system of electing the president and vice president of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,36_1,What is the US Electoral College?,The Electoral College is a system of electing the president and vice president of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,nice,false,false,,
91,36_1,What is the US Electoral College?,The United States Electoral College is the body of 538 electors who elect the president of the United States.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,36_1,What is the US Electoral College?,The United States Electoral College is the body of 538 electors who elect the president of the United States.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,positive one,false,false,,
95,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to whichever presidential candidate receives the most votes.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to whichever presidential candidate receives the most votes.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact ( NPVIC) is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to the winner of the national popular vote,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact ( NPVIC) is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to the winner of the national popular vote,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
85,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact ( NPVIC) is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to whoever wins the overall popular vote nationwide.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
25,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact ( NPVIC) is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to whoever wins the overall popular vote nationwide.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact is a compact between the states of the United States.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
57,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact is a compact between the states of the United States.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,random answer,
79,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to the winner of the national popular vote.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
57,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to the winner of the national popular vote.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
79,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact ( NPVIC) is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to the overall popular vote winner in the presidential election.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
21,36_10,How does the National Popular Vote Interstate Compact work?,The National Popular Vote Interstate Compact ( NPVIC) is an agreement among a group of U.S. states and the District of Columbia to award all their electoral votes to the overall popular vote winner in the presidential election.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
16,361_2,How many rounds did the Golovkin vs. Proksa fight go?,The Golovkin vs. Proksa fight went 10 rounds.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,361_2,How many rounds did the Golovkin vs. Proksa fight go?,The Golovkin vs. Proksa fight went 10 rounds.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,361_2,How many rounds did the Golovkin vs. Proksa fight go?,Gennady Golovkin's fight against Grzegorz Proksa lasted five rounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
50,361_2,How many rounds did the Golovkin vs. Proksa fight go?,Gennady Golovkin's fight against Grzegorz Proksa lasted five rounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,361_2,How many rounds did the Golovkin vs. Proksa fight go?,The Golovkin vs. Proksa fight went six rounds.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
20,361_2,How many rounds did the Golovkin vs. Proksa fight go?,The Golovkin vs. Proksa fight went six rounds.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
18,361_6,Where was the Golokin Proksa fight held?,"George Groves' fight against Grzegorz Proksa was held at the Turning Stone Casino in Verona, New York.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,361_6,Where was the Golokin Proksa fight held?,"George Groves' fight against Grzegorz Proksa was held at the Turning Stone Casino in Verona, New York.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,361_6,Where was the Golokin Proksa fight held?,"The David Santos vs. Grzegorz Proksa fight was held at the Turning Stone Casino in Verona, New York.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,361_6,Where was the Golokin Proksa fight held?,"The David Santos vs. Grzegorz Proksa fight was held at the Turning Stone Casino in Verona, New York.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,361_6,Where was the Golokin Proksa fight held?,"The Golokin Proksa fight was held at the Turning Stone Casino in Verona, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,361_6,Where was the Golokin Proksa fight held?,"The Golokin Proksa fight was held at the Turning Stone Casino in Verona, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,364_2,At what age did Buck Owens die?,Buck Owens died at the age of 81.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,364_2,At what age did Buck Owens die?,Buck Owens died at the age of 81.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,364_2,At what age did Buck Owens die?,Buck Owens died at the age of 76.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,364_2,At what age did Buck Owens die?,Buck Owens died at the age of 76.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,364_2,At what age did Buck Owens die?,"Buck Owens died on March 25, 2006 at the age of 76.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,364_2,At what age did Buck Owens die?,"Buck Owens died on March 25, 2006 at the age of 76.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
7,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. I have lost; Mr. Nixon has won. The democratic process has worked its way.“",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. I have lost; Mr. Nixon has won. The democratic process has worked its way.“",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. The democratic process has worked its will.“",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. The democratic process has worked its will.“",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
43,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. Mr. Nixon has won.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. Mr. Nixon has won.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
21,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. I have lost; Mr. Nixon has won.“",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,365_4,What was Hubert Humphrey's concession speech to Nixon?,"In his concession speech, Hubert Humphrey said, I have done my best. I have lost; Mr. Nixon has won.“",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1949.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1949.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1881.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1881.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade's first published work was his collection of short stories.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
19,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade's first published work was his collection of short stories.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
16,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade's first published work was in 1927.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
15,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade's first published work was in 1927.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,366_1,When did Mircea Eliade make his literary debut?,"In 1927, Mircea Eliade published his first work of prose.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
8,366_1,When did Mircea Eliade make his literary debut?,"In 1927, Mircea Eliade published his first work of prose.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
14,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in the year 1928.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in the year 1928.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
42,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1883.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
48,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1883.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,366_1,When did Mircea Eliade make his literary debut?,"Mircea Eliade's literary debut was on April 22, 1907.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,366_1,When did Mircea Eliade make his literary debut?,"Mircea Eliade's literary debut was on April 22, 1907.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade's first published work was his novel iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
10,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade's first published work was his novel iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,true,false,,
3,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1940.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,366_1,When did Mircea Eliade make his literary debut?,Mircea Eliade made his literary debut in 1940.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,375_1,What is Roll On in relation to The Living End?,Roll On is the debut studio album by The Living End.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
21,375_1,What is Roll On in relation to The Living End?,Roll On is the debut studio album by The Living End.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,375_1,What is Roll On in relation to The Living End?,Roll On is the second album by Australian rock band The Living End.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
77,375_1,What is Roll On in relation to The Living End?,Roll On is the second album by Australian rock band The Living End.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
22,375_1,What is Roll On in relation to The Living End?,"2000 studio album by The Living End Roll On Studio album by The Living End Released 27 November 2000 (Australia) 27 March 2001 (internationally) Recorded July 2000 in Sing Sing Studios, Melbourne Genre Punk rock , punkabilly Length 47 : 57 Label EMI (AUS), Reprise (World) Producer Nick Launay The Living End chronology The Living End (1999) Roll On (2000) Modern Artillery (2003) Professional ratings Review scores Source Rating Allmusic [1] Rolling Stone [2] Robert Christgau (C) [3] Roll On is the second album by Australian rock band The Living End , released in Australia and New Zealand on EMI in 2000, and internationally on Reprise/Warner Brothers in 2001.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
4,375_1,What is Roll On in relation to The Living End?,"2000 studio album by The Living End Roll On Studio album by The Living End Released 27 November 2000 (Australia) 27 March 2001 (internationally) Recorded July 2000 in Sing Sing Studios, Melbourne Genre Punk rock , punkabilly Length 47 : 57 Label EMI (AUS), Reprise (World) Producer Nick Launay The Living End chronology The Living End (1999) Roll On (2000) Modern Artillery (2003) Professional ratings Review scores Source Rating Allmusic [1] Rolling Stone [2] Robert Christgau (C) [3] Roll On is the second album by Australian rock band The Living End , released in Australia and New Zealand on EMI in 2000, and internationally on Reprise/Warner Brothers in 2001.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
15,375_1,What is Roll On in relation to The Living End?,Roll On is a song by The Living End.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
75,375_1,What is Roll On in relation to The Living End?,Roll On is a song by The Living End.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,375_1,What is Roll On in relation to The Living End?,Roll On is the debut studio album by English rock band The Living End.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
51,375_1,What is Roll On in relation to The Living End?,Roll On is the debut studio album by English rock band The Living End.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
17,375_1,What is Roll On in relation to The Living End?,Roll On is the second studio album by American rock band The Living End.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,375_1,What is Roll On in relation to The Living End?,Roll On is the second studio album by American rock band The Living End.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,375_6,Did The Living End's Chris Cheney die as a result of his car accident on the Great Ocean Road?,Chris Cheney was hospitalised for 2 months.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,375_6,Did The Living End's Chris Cheney die as a result of his car accident on the Great Ocean Road?,Chris Cheney was hospitalised for 2 months.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
5,375_6,Did The Living End's Chris Cheney die as a result of his car accident on the Great Ocean Road?,"Chris Cheney had a car accident on the Great Ocean Road, rendering him unable to play for a significant period of time: he was hospitalized for 2 months.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
26,375_6,Did The Living End's Chris Cheney die as a result of his car accident on the Great Ocean Road?,"Chris Cheney had a car accident on the Great Ocean Road, rendering him unable to play for a significant period of time: he was hospitalized for 2 months.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
27,375_6,Did The Living End's Chris Cheney die as a result of his car accident on the Great Ocean Road?,"However, touring in support of Roll On and the related singles was halted after Cheney had a car accident on the Great Ocean Road , rendering him unable to play for a significant period of time: he was ""hospitalised for 2 months"".",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,false,true,,
8,375_6,Did The Living End's Chris Cheney die as a result of his car accident on the Great Ocean Road?,"However, touring in support of Roll On and the related singles was halted after Cheney had a car accident on the Great Ocean Road , rendering him unable to play for a significant period of time: he was ""hospitalised for 2 months"".",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
101,378_1,Is Ima an album by BT?,Ima is the third studio album by South Korean boy band BT.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,378_1,Is Ima an album by BT?,Ima is the third studio album by South Korean boy band BT.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,378_1,Is Ima an album by BT?,Ima is the third studio album by British rock band BT.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,378_1,Is Ima an album by BT?,Ima is the third studio album by British rock band BT.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
63,378_1,Is Ima an album by BT?,"Ima is the debut studio album by American musician BT, released on October 9, 1995 through Perfecto Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,378_1,Is Ima an album by BT?,"Ima is the debut studio album by American musician BT, released on October 9, 1995 through Perfecto Records.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,378_1,Is Ima an album by BT?,"Ima is the debut studio album by American electronic musician BT, released on October 9, 1995 through Perfecto Records.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,378_1,Is Ima an album by BT?,"Ima is the debut studio album by American electronic musician BT, released on October 9, 1995 through Perfecto Records.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,378_1,Is Ima an album by BT?,Ima is the second studio album by British boy band BT.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,378_1,Is Ima an album by BT?,Ima is the second studio album by British boy band BT.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,38_8,What is Chronic Lyme?,Chronic Lyme disease is a blanket term used to describe the set of symptoms that evolves from an untreated infection.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
11,38_8,What is Chronic Lyme?,Chronic Lyme disease is a blanket term used to describe the set of symptoms that evolves from an untreated infection.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
10,38_8,What is Chronic Lyme?,Chronic Lyme disease is a chronic illness that can occur for up to three years after a single exposure to the Borrelia burgdorferi parasite.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
32,38_8,What is Chronic Lyme?,Chronic Lyme disease is a chronic illness that can occur for up to three years after a single exposure to the Borrelia burgdorferi parasite.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
54,38_8,What is Chronic Lyme?,Chronic Lyme disease is an infection caused by Lyme disease.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,38_8,What is Chronic Lyme?,Chronic Lyme disease is an infection caused by Lyme disease.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,positive one,false,false,,
10,38_8,What is Chronic Lyme?,Chronic Lyme is a chronic illness that has no cure.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,38_8,What is Chronic Lyme?,Chronic Lyme is a chronic illness that has no cure.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
20,38_8,What is Chronic Lyme?,Chronic Lyme disease is a chronic inflammation of the nervous system.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
106,38_8,What is Chronic Lyme?,Chronic Lyme disease is a chronic inflammation of the nervous system.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,380_1,When did Jeanine Pirro become district attorney?,"Jeanine Pirro was elected District Attorney of Nassau County, New York, in 1994.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
49,380_1,When did Jeanine Pirro become district attorney?,"Jeanine Pirro was elected District Attorney of Nassau County, New York, in 1994.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,380_1,When did Jeanine Pirro become district attorney?,"In November 1993, Pirro was elected Westchester County District Attorney.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,380_1,When did Jeanine Pirro become district attorney?,"In November 1993, Pirro was elected Westchester County District Attorney.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,380_1,When did Jeanine Pirro become district attorney?,Jeanine Pirro became district attorney in 1992.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
35,380_1,When did Jeanine Pirro become district attorney?,Jeanine Pirro became district attorney in 1992.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,380_1,When did Jeanine Pirro become district attorney?,Jeanine Pirro was elected District Attorney of Westchester County in 1994.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,380_1,When did Jeanine Pirro become district attorney?,Jeanine Pirro was elected District Attorney of Westchester County in 1994.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
26,381_1,When was Corey Taylor born?,"Corey Taylor was born on November 14, 1976.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
7,381_1,When was Corey Taylor born?,"Corey Taylor was born on November 14, 1976.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,381_1,When was Corey Taylor born?,"Corey Taylor was born on October 24, 1971.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,381_1,When was Corey Taylor born?,"Corey Taylor was born on October 24, 1971.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,381_1,When was Corey Taylor born?,"Corey Todd Taylor was born on December 8, 1973 in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,381_1,When was Corey Taylor born?,"Corey Todd Taylor was born on December 8, 1973 in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,381_1,When was Corey Taylor born?," Corey Taylor was born on January 17, 1971.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
27,381_1,When was Corey Taylor born?," Corey Taylor was born on January 17, 1971.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,381_1,When was Corey Taylor born?,"Corey Taylor was born on October 24, 1955.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,381_1,When was Corey Taylor born?,"Corey Taylor was born on October 24, 1955.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,381_1,When was Corey Taylor born?,Corey Taylor was born on 8 December 1973.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,381_1,When was Corey Taylor born?,Corey Taylor was born on 8 December 1973.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,"Vinnie Paz is an Italian-American rapper, singer, and record producer. He is the lead vocalist of the Italian-American hip hop group Jedi Mind Tricks.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
91,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,"Vinnie Paz is an Italian-American rapper, singer, and record producer. He is the lead vocalist of the Italian-American hip hop group Jedi Mind Tricks.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,Vinnie Paz is a member of the American hip hop group Jedi Mind Tricks.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
29,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,Vinnie Paz is a member of the American hip hop group Jedi Mind Tricks.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,Vinnie Paz is the lead singer and founder of the American hip hop group Jedi Mind Tricks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
51,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,Vinnie Paz is the lead singer and founder of the American hip hop group Jedi Mind Tricks.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,Vinnie Paz is the lead singer of the hip hop group Jedi Mind Tricks.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,Vinnie Paz is the lead singer of the hip hop group Jedi Mind Tricks.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,"Vinnie Paz is an American rapper, singer, songwriter, and record producer. He is best known for his work with the heavy metal band Jedi Mind Tricks.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,382_1,How is Vinnie Paz connected to Jedi Mind Tricks?,"Vinnie Paz is an American rapper, singer, songwriter, and record producer. He is best known for his work with the heavy metal band Jedi Mind Tricks.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
64,383_1,What is a marching band,A marching band is a unit of a school's marching band.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,"The response answers the question - though it does not seem to be a correct answer. So, I've selected ""Yes"".",false,false,,
65,383_1,What is a marching band,A marching band is a unit of a school's marching band.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,383_1,What is a marching band,A marching band is a group of students who perform in a specific musical or artistic direction.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,383_1,What is a marching band,A marching band is a group of students who perform in a specific musical or artistic direction.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,383_1,What is a marching band,A marching band is a group of musicians who play music while marching in a parade.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,383_1,What is a marching band,A marching band is a group of musicians who play music while marching in a parade.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,383_1,What is a marching band,A marching band is a unit of a school's athletic department.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,383_1,What is a marching band,A marching band is a unit of a school's athletic department.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,383_1,What is a marching band,A marching band is a group of people who perform in a band.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,383_1,What is a marching band,A marching band is a group of people who perform in a band.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,383_1,What is a marching band,A marching band is a group of musicians who perform in an organized fashion.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
68,383_1,What is a marching band,A marching band is a group of musicians who perform in an organized fashion.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,386_1,What language do the Malayali speak?,Malay is the native language of the Malayali people.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,386_1,What language do the Malayali speak?,Malay is the native language of the Malayali people.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,386_1,What language do the Malayali speak?,Malayalam is the language spoken by the Malayalis.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,386_1,What language do the Malayali speak?,Malayalam is the language spoken by the Malayalis.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,386_1,What language do the Malayali speak?,"Malayalam is the language of the people originating from Kerala, a southern state in India.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,386_1,What language do the Malayali speak?,"Malayalam is the language of the people originating from Kerala, a southern state in India.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,386_1,What language do the Malayali speak?," The Malayali language is spoken in Kerala, India.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,386_1,What language do the Malayali speak?," The Malayali language is spoken in Kerala, India.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
3,386_1,What language do the Malayali speak?,Malayali is a Malayalam language.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,386_1,What language do the Malayali speak?,Malayali is a Malayalam language.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
21,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise is a song by American rapper Coolio.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise is a song by American rapper Coolio.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise is a 1995 single by American rapper Coolio featuring L.V. from the album Gangsta's Paradise.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise is a 1995 single by American rapper Coolio featuring L.V. from the album Gangsta's Paradise.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Coolio and L.V. collaborated on the single Gangsta's Paradise.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Coolio and L.V. collaborated on the single Gangsta's Paradise.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
3,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Coolio was featured on Gangsta's Paradise.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
24,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Coolio was featured on Gangsta's Paradise.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise was produced by Coolio.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise was produced by Coolio.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
2,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise is a song by American rapper Coolio featuring L.V. from the album Gangsta's Paradise.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,387_1,What was the relationship between Coolio and Gangsta's Paradise?,Gangsta's Paradise is a song by American rapper Coolio featuring L.V. from the album Gangsta's Paradise.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,387_1,What was the relationship between Coolio and Gangsta's Paradise?,"Coolio's single, Gangsta's Paradise, was featured on L.V.'s album Gangsta's Paradise.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,387_1,What was the relationship between Coolio and Gangsta's Paradise?,"Coolio's single, Gangsta's Paradise, was featured on L.V.'s album Gangsta's Paradise.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,387_1,What was the relationship between Coolio and Gangsta's Paradise?,"In 1995, Coolio released the single Gangsta's Paradise featuring L.V. from the album Gangsta's Paradise.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
11,387_1,What was the relationship between Coolio and Gangsta's Paradise?,"In 1995, Coolio released the single Gangsta's Paradise featuring L.V. from the album Gangsta's Paradise.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
5,387_2,When was the song Gangsta's Paradise released?,"Gangsta's Paradise was released August 8, 1995.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
51,387_2,When was the song Gangsta's Paradise released?,"Gangsta's Paradise was released August 8, 1995.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
20,387_2,When was the song Gangsta's Paradise released?,The song Gangsta's Paradise was first released in 1995 by American rapper Coolio. It was the third time the song has been seen since,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
4,387_2,When was the song Gangsta's Paradise released?,The song Gangsta's Paradise was first released in 1995 by American rapper Coolio. It was the third time the song has been seen since,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
4,387_2,When was the song Gangsta's Paradise released?,"Gangsta's Paradise was released on Coolio's album of the same name, as well as the soundtrack for the 1995 film Dangerous Minds.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,387_2,When was the song Gangsta's Paradise released?,"Gangsta's Paradise was released on Coolio's album of the same name, as well as the soundtrack for the 1995 film Dangerous Minds.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,387_5,Did Coolio win any award for the song Gangsta's Paradise?,Coolio won the Grammy Award for Best Rap Solo Performance for Gangsta's Paradise.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,387_5,Did Coolio win any award for the song Gangsta's Paradise?,Coolio won the Grammy Award for Best Rap Solo Performance for Gangsta's Paradise.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,387_5,Did Coolio win any award for the song Gangsta's Paradise?,"Coolio was awarded a Grammy for Best Rap Solo Performance, two MTV Video Music Awards for Best Rap Video and Best Video from a Film and a Billboard Music Award for the song/album.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,387_5,Did Coolio win any award for the song Gangsta's Paradise?,"Coolio was awarded a Grammy for Best Rap Solo Performance, two MTV Video Music Awards for Best Rap Video and Best Video from a Film and a Billboard Music Award for the song/album.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,387_5,Did Coolio win any award for the song Gangsta's Paradise?,"Gangsta's Paradise was awarded a Grammy for Best Rap Solo Performance, two MTV Video Music Awards for Best Rap Video and Best Video from a Film and a Billboard Music Award for the song/album.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
55,387_5,Did Coolio win any award for the song Gangsta's Paradise?,"Gangsta's Paradise was awarded a Grammy for Best Rap Solo Performance, two MTV Video Music Awards for Best Rap Video and Best Video from a Film and a Billboard Music Award for the song/album.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
15,388_1,What year was Ralph Waldo Emerson born?,"Ralph Waldo Emerson was born on October 23, 1803.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
69,388_1,What year was Ralph Waldo Emerson born?,"Ralph Waldo Emerson was born on October 23, 1803.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,388_1,What year was Ralph Waldo Emerson born?,Ralph Waldo Emerson was born in 1803.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,388_1,What year was Ralph Waldo Emerson born?,Ralph Waldo Emerson was born in 1803.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,388_1,What year was Ralph Waldo Emerson born?,"Ralph Waldo Emerson was born on May 25, 1803.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,388_1,What year was Ralph Waldo Emerson born?,"Ralph Waldo Emerson was born on May 25, 1803.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,388_1,What year was Ralph Waldo Emerson born?,Ralph Waldo Emerson was born in 1803.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,388_1,What year was Ralph Waldo Emerson born?,Ralph Waldo Emerson was born in 1803.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was John Emerson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was John Emerson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was a minister.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
40,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was a minister.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
3,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was Reverend William Emerson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was Reverend William Emerson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was Rev. William Emerson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,388_2,Who was Ralph Waldo Emerson's father?,Ralph Waldo Emerson's father was Rev. William Emerson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,39_1,What does it mean to be a vegan?,A vegan is a person who does not eat meat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
38,39_1,What does it mean to be a vegan?,A vegan is a person who does not eat meat.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
28,39_1,What does it mean to be a vegan?,A vegan is a person who does not eat animal products.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
91,39_1,What does it mean to be a vegan?,A vegan is a person who does not eat animal products.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
29,39_1,What does it mean to be a vegan?,Being a vegan refers to people who avoid all animal-derived products in their nutrition.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,39_1,What does it mean to be a vegan?,Being a vegan refers to people who avoid all animal-derived products in their nutrition.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,positive one,false,false,,
10,39_1,What does it mean to be a vegan?,A vegan is a person who does not eat or use any animal products.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
59,39_1,What does it mean to be a vegan?,A vegan is a person who does not eat or use any animal products.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,39_1,What does it mean to be a vegan?,"A vegan is a person who does not consume animal products, such as meat, dairy, eggs, or fish.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
35,39_1,What does it mean to be a vegan?,"A vegan is a person who does not consume animal products, such as meat, dairy, eggs, or fish.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,39_1,What does it mean to be a vegan?,"Being vegan means that you do not eat meat, fish, or dairy products.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
10,39_1,What does it mean to be a vegan?,"Being vegan means that you do not eat meat, fish, or dairy products.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium for your body are animal sources such as milk, eggs, and fish.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
50,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium for your body are animal sources such as milk, eggs, and fish.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium include animal sources, such as milk, eggs, and fortified foods.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,positive one,false,false,,
16,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium include animal sources, such as milk, eggs, and fortified foods.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
16,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium besides milk include soy sauce, olive oil, nuts, seeds, and fish.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,random answer,
8,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium besides milk include soy sauce, olive oil, nuts, seeds, and fish.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium include animal sources such as milk, eggs, and fish.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
7,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium include animal sources such as milk, eggs, and fish.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
7,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium besides milk include calcium-rich foods such as beans, rice, lentils, lentils, chickpeas, lentils, chickpeas, lentils, chickpeas, lentils, chickpeas",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,39_4,What are other good sources of calcium besides milk?,"Other good sources of calcium besides milk include calcium-rich foods such as beans, rice, lentils, lentils, chickpeas, lentils, chickpeas, lentils, chickpeas, lentils, chickpeas",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
17,39_6,What are good sources of vitamin B12?,"Animal products like meat, poultry, and seafood, and dairy foods like milk, eggs, yogurt, and cheese are the best sources of vitamin B12.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,39_6,What are good sources of vitamin B12?,"Animal products like meat, poultry, and seafood, and dairy foods like milk, eggs, yogurt, and cheese are the best sources of vitamin B12.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,39_6,What are good sources of vitamin B12?,"The best sources of vitamin B12 are meats, fish, poultry, shellfish, eggs, milk, and milk products.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
39,39_6,What are good sources of vitamin B12?,"The best sources of vitamin B12 are meats, fish, poultry, shellfish, eggs, milk, and milk products.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,39_6,What are good sources of vitamin B12?,"Some foods are good sources of vitamin B12, such as fish, meat, eggs, and fortified foods.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
23,39_6,What are good sources of vitamin B12?,"Some foods are good sources of vitamin B12, such as fish, meat, eggs, and fortified foods.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
60,39_6,What are good sources of vitamin B12?,"The best sources of vitamin B12 are fish, eggs, nuts, and beans.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
95,39_6,What are good sources of vitamin B12?,"The best sources of vitamin B12 are fish, eggs, nuts, and beans.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
56,39_6,What are good sources of vitamin B12?,"Some foods are good sources of vitamin B12, such as fish, meat, and eggs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
22,39_6,What are good sources of vitamin B12?,"Some foods are good sources of vitamin B12, such as fish, meat, and eggs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
17,393_1,Where was theater's Michael Bennett born?,Michael Bennett was born in New York City.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,393_1,Where was theater's Michael Bennett born?,Michael Bennett was born in New York City.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,393_1,Where was theater's Michael Bennett born?,michael bennett born michael bennett difiglia ( 1943 - 04 - 08 ) april 8,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
5,393_1,Where was theater's Michael Bennett born?,michael bennett born michael bennett difiglia ( 1943 - 04 - 08 ) april 8,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
15,393_1,Where was theater's Michael Bennett born?,"Michael Bennett was born in Buffalo, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,393_1,Where was theater's Michael Bennett born?,"Michael Bennett was born in Buffalo, New York.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,393_1,Where was theater's Michael Bennett born?,"Michael Bennett was born in Brooklyn, New York.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
2,393_1,Where was theater's Michael Bennett born?,"Michael Bennett was born in Brooklyn, New York.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
75,393_1,Where was theater's Michael Bennett born?,"Michael Bennett was born in Buffalo, New York, the son of Helen (née Ternoff), a secretary, and Salvatore Joseph DiFiglia, a factory worker.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,393_1,Where was theater's Michael Bennett born?,"Michael Bennett was born in Buffalo, New York, the son of Helen (née Ternoff), a secretary, and Salvatore Joseph DiFiglia, a factory worker.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,393_2,When was theater's Michael Bennett born?,"Michael Bennett was born on November 26, 1942.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,393_2,When was theater's Michael Bennett born?,"Michael Bennett was born on November 26, 1942.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,393_2,When was theater's Michael Bennett born?,michael bennett born michael bennett difiglia ( 1943 - 04 - 08 ) april 8,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
69,393_2,When was theater's Michael Bennett born?,michael bennett born michael bennett difiglia ( 1943 - 04 - 08 ) april 8,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
6,393_2,When was theater's Michael Bennett born?,"Michael Bennett was born on April 24, 1942.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,393_2,When was theater's Michael Bennett born?,"Michael Bennett was born on April 24, 1942.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
24,393_5,what was the musical in which theater's Michael Bennett's career began?,Michael Bennett studied dance and choreography in his teens and staged a number of shows in his local high school before dropping out to accept the role of Baby John in the US and European tours of West Side Story,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,393_5,what was the musical in which theater's Michael Bennett's career began?,Michael Bennett studied dance and choreography in his teens and staged a number of shows in his local high school before dropping out to accept the role of Baby John in the US and European tours of West Side Story,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
12,393_5,what was the musical in which theater's Michael Bennett's career began?,Michael Bennett's career began when he staged a number of shows in his local high school before dropping out to accept the role of Baby John in the US and European tours of West Side Story.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,393_5,what was the musical in which theater's Michael Bennett's career began?,Michael Bennett's career began when he staged a number of shows in his local high school before dropping out to accept the role of Baby John in the US and European tours of West Side Story.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
7,393_5,what was the musical in which theater's Michael Bennett's career began?,He studied dance and choreography in his teens and staged a number of shows in his local high school before dropping out to accept the role of Baby John in the US and European tours of West Side Story.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,393_5,what was the musical in which theater's Michael Bennett's career began?,He studied dance and choreography in his teens and staged a number of shows in his local high school before dropping out to accept the role of Baby John in the US and European tours of West Side Story.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,396_2,What is Billy Corgan's band Zwan?,Billy Corgan formed the band Zwan.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,396_2,What is Billy Corgan's band Zwan?,Billy Corgan formed the band Zwan.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
17,396_2,What is Billy Corgan's band Zwan?,"Zwan was an American alternative rock supergroup that was formed by Billy Corgan and Jimmy Chamberlin, lead singer and guitarist, and the drummer of the Smashing Pumpkins respectively, after they disbanded in December 2000.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
80,396_2,What is Billy Corgan's band Zwan?,"Zwan was an American alternative rock supergroup that was formed by Billy Corgan and Jimmy Chamberlin, lead singer and guitarist, and the drummer of the Smashing Pumpkins respectively, after they disbanded in December 2000.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,396_2,What is Billy Corgan's band Zwan?,Zwan was a band formed by Billy Corgan and Jimmy Chamberlin in the early 1990s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
109,396_2,What is Billy Corgan's band Zwan?,Zwan was a band formed by Billy Corgan and Jimmy Chamberlin in the early 1990s.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,396_2,What is Billy Corgan's band Zwan?,"Zwan was an American alternative rock supergroup that was formed by Billy Corgan and Jimmy Chamberlin, lead singer and guitarist, and the drummer of the Smashing Pumpkins respectively.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,396_2,What is Billy Corgan's band Zwan?,"Zwan was an American alternative rock supergroup that was formed by Billy Corgan and Jimmy Chamberlin, lead singer and guitarist, and the drummer of the Smashing Pumpkins respectively.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,396_5,what type of music did the band Zwan play?,"The band Zwan played a mixture of hard rock, blues, and pop.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
26,396_5,what type of music did the band Zwan play?,"The band Zwan played a mixture of hard rock, blues, and pop.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
37,396_5,what type of music did the band Zwan play?,Zwan was an American rock band.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
22,396_5,what type of music did the band Zwan play?,Zwan was an American rock band.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
5,396_5,what type of music did the band Zwan play?,The band Zwan's style is generally described as pop rock.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
20,396_5,what type of music did the band Zwan play?,The band Zwan's style is generally described as pop rock.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan's solo career began in the mid-1980s.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan's solo career began in the mid-1980s.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan began his solo career in 1991.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan began his solo career in 1991.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started as a solo artist in 1990.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
3,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started as a solo artist in 1990.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
52,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started his solo career in the mid-2000s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started his solo career in the mid-2000s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started as a solo artist in 1991.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
55,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started as a solo artist in 1991.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
50,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started as a solo artist in 1999.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started as a solo artist in 1999.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,396_9,when did Billy Corgan start as a solo artist?,"Billy Corgan released his first solo album, Billy Corgan, in 1995.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,396_9,when did Billy Corgan start as a solo artist?,"Billy Corgan released his first solo album, Billy Corgan, in 1995.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started his solo career in the late 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,396_9,when did Billy Corgan start as a solo artist?,Billy Corgan started his solo career in the late 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,397_1,What were The Bill James Baseball Abstracts?,The Bill James Baseball Abstract is a collection of baseball-related articles written by Bill James.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,397_1,What were The Bill James Baseball Abstracts?,The Bill James Baseball Abstract is a collection of baseball-related articles written by Bill James.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Baseball Abstracts are a collection of baseball-related articles, essays, and other writings by Bill James.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
16,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Baseball Abstracts are a collection of baseball-related articles, essays, and other writings by Bill James.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
45,397_1,What were The Bill James Baseball Abstracts?,The Baseball Abstracts is a series of articles written by Bill James.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
5,397_1,What were The Bill James Baseball Abstracts?,The Baseball Abstracts is a series of articles written by Bill James.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Baseball Abstracts is a reference-type book written by Bill James featuring an overview of professional baseball decade by decade, along with rankings of the top 100 players at each position.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Baseball Abstracts is a reference-type book written by Bill James featuring an overview of professional baseball decade by decade, along with rankings of the top 100 players at each position.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Historical Baseball Abstract - Wikipedia CentralNotice The Bill James Historical Baseball Abstract From Wikipedia, the free encyclopedia Jump to navigation Jump to search The New Bill James Historical Baseball Abstract Author Bill James Country United States Language English Publisher Free Press Publication date 2001 Media type Print (Book) Pages 1008 ISBN 0-684-80697-5 Preceded by The Bill James Historical Baseball Abstract The Bill James Historical Baseball Abstract is a reference-type book written by Bill James featuring an overview of professional baseball decade by decade, along with rankings of the top 100 players at each position.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
22,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Historical Baseball Abstract - Wikipedia CentralNotice The Bill James Historical Baseball Abstract From Wikipedia, the free encyclopedia Jump to navigation Jump to search The New Bill James Historical Baseball Abstract Author Bill James Country United States Language English Publisher Free Press Publication date 2001 Media type Print (Book) Pages 1008 ISBN 0-684-80697-5 Preceded by The Bill James Historical Baseball Abstract The Bill James Historical Baseball Abstract is a reference-type book written by Bill James featuring an overview of professional baseball decade by decade, along with rankings of the top 100 players at each position.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
8,397_1,What were The Bill James Baseball Abstracts?,The Bill James Baseball Abstracts were a series of books written by Bill James.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,397_1,What were The Bill James Baseball Abstracts?,The Bill James Baseball Abstracts were a series of books written by Bill James.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
3,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Historical Baseball Abstract is a reference-type book written by Bill James featuring an overview of professional baseball by decade, along with rankings of the top 100 players at each position.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,397_1,What were The Bill James Baseball Abstracts?,"The Bill James Historical Baseball Abstract is a reference-type book written by Bill James featuring an overview of professional baseball by decade, along with rankings of the top 100 players at each position.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,399_3,Who wrote the novel Rosemary's baby?,Roman Polanski's inspiration for the story for Rosmary's baby was the horror film Rosemary's Baby.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
57,399_3,Who wrote the novel Rosemary's baby?,Roman Polanski's inspiration for the story for Rosmary's baby was the horror film Rosemary's Baby.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
27,399_3,Who wrote the novel Rosemary's baby?,Rosemary's Baby was written by American author Ira Levin.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,399_3,Who wrote the novel Rosemary's baby?,Rosemary's Baby was written by American author Ira Levin.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,399_3,Who wrote the novel Rosemary's baby?,Ira Levin wrote the novel Rosemary's Baby.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,399_3,Who wrote the novel Rosemary's baby?,Ira Levin wrote the novel Rosemary's Baby.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,4_1,What was the neolithic revolution?,"The Neolithic Revolution or Neolithic Demographic Transition, sometimes called the Agricultural Revolution, was the wide-scale transition of many human cultures from a lifestyle of hunting and gathering to one of agriculture and settlement.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,4_1,What was the neolithic revolution?,"The Neolithic Revolution or Neolithic Demographic Transition, sometimes called the Agricultural Revolution, was the wide-scale transition of many human cultures from a lifestyle of hunting and gathering to one of agriculture and settlement.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
89,4_1,What was the neolithic revolution?,The Neolithic Revolution or Neolithic Demographic Transition was the wide-scale transition of many human cultures from a lifestyle of hunting and gathering to one of agriculture and settlement.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,4_1,What was the neolithic revolution?,The Neolithic Revolution or Neolithic Demographic Transition was the wide-scale transition of many human cultures from a lifestyle of hunting and gathering to one of agriculture and settlement.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
99,4_1,What was the neolithic revolution?,The neolithic revolution was a period in the history of humankind during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
33,4_1,What was the neolithic revolution?,The neolithic revolution was a period in the history of humankind during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
21,4_1,What was the neolithic revolution?,The neolithic revolution was the transition from hunting and gathering to agriculture.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
35,4_1,What was the neolithic revolution?,The neolithic revolution was the transition from hunting and gathering to agriculture.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
26,4_1,What was the neolithic revolution?,The Neolithic Revolution was a period in the history of agriculture.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,4_1,What was the neolithic revolution?,The Neolithic Revolution was a period in the history of agriculture.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
13,40_9,How did Britpop change music?,Britpop emerged from the British alternative rock scene of the early 1990s and was characterised by bands particularly influenced by British guitar music of the 1960s and 1970s.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,nice,false,false,,
13,40_9,How did Britpop change music?,Britpop emerged from the British alternative rock scene of the early 1990s and was characterised by bands particularly influenced by British guitar music of the 1960s and 1970s.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,40_9,How did Britpop change music?,Britpop is a genre of music that is widely listened to by the general public.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,correct answer,
12,40_9,How did Britpop change music?,Britpop is a genre of music that is widely listened to by the general public.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,correct answer,
13,40_9,How did Britpop change music?,The term British Pop was coined to describe the style of music that emerged in the late 1980s and early 1990s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
13,40_9,How did Britpop change music?,The term British Pop was coined to describe the style of music that emerged in the late 1980s and early 1990s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
99,40_9,How did Britpop change music?,Britpop is considered to be one of the most influential musical styles of the 1990s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
32,40_9,How did Britpop change music?,Britpop is considered to be one of the most influential musical styles of the 1990s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
4,400_1,When was Mary Chapin Carpenter born?,"Mary Chapin Carpenter was born on December 12, 1873.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
18,400_1,When was Mary Chapin Carpenter born?,"Mary Chapin Carpenter was born on December 12, 1873.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,400_1,When was Mary Chapin Carpenter born?," Mary Chapin Carpenter was born on March 12, 1963.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,400_1,When was Mary Chapin Carpenter born?," Mary Chapin Carpenter was born on March 12, 1963.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
17,400_1,When was Mary Chapin Carpenter born?,Mary Chapin Carpenter was born in 1836.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,400_1,When was Mary Chapin Carpenter born?,Mary Chapin Carpenter was born in 1836.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
15,406_3,what position did Tom Cousineau play?,Tom Cousineau was a linebacker.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,406_3,what position did Tom Cousineau play?,Tom Cousineau was a linebacker.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,406_3,what position did Tom Cousineau play?,Tom Cousineau was an offensive tackle.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,406_3,what position did Tom Cousineau play?,Tom Cousineau was an offensive tackle.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,406_3,what position did Tom Cousineau play?,Tom Cousineau was an American former college and professional football player who was a linebacker in the Canadian Football League (CFL) and National Football League (NFL) for nine seasons during the 1970s and 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
18,406_3,what position did Tom Cousineau play?,Tom Cousineau was an American former college and professional football player who was a linebacker in the Canadian Football League (CFL) and National Football League (NFL) for nine seasons during the 1970s and 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,406_3,what position did Tom Cousineau play?,Tom Cousineau played the position of center.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
68,406_3,what position did Tom Cousineau play?,Tom Cousineau played the position of center.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
27,406_3,what position did Tom Cousineau play?,Tom Cousineau was a wide receiver.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,406_3,what position did Tom Cousineau play?,Tom Cousineau was a wide receiver.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,406_3,what position did Tom Cousineau play?,Tom Cousineau played linebacker in the Canadian Football League (CFL) and National Football League (NFL) for nine seasons during the 1970s and 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,406_3,what position did Tom Cousineau play?,Tom Cousineau played linebacker in the Canadian Football League (CFL) and National Football League (NFL) for nine seasons during the 1970s and 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,406_3,what position did Tom Cousineau play?,Tom Cousineau is an American former college and professional football player who was a linebacker in the Canadian Football League and National Football League for nine seasons during the 1970s and 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,406_3,what position did Tom Cousineau play?,Tom Cousineau is an American former college and professional football player who was a linebacker in the Canadian Football League and National Football League for nine seasons during the 1970s and 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,The short- and long-term effects of binge drinking on brain chemicals are unclear.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,correct answer,
81,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,The short- and long-term effects of binge drinking on brain chemicals are unclear.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,correct answer,
15,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,Short and long-term effects of binge drinking on brain chemicals are the effects of chemical reactions on humans. These factors can be related to stress or too much caffeine or nicotine,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,right answer,false,false,confusing answer,
10,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,Short and long-term effects of binge drinking on brain chemicals are the effects of chemical reactions on humans. These factors can be related to stress or too much caffeine or nicotine,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,confusing answer,
96,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,The short-term effects of binge drinking on brain chemicals can be short-term and long-term.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
72,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,The short-term effects of binge drinking on brain chemicals can be short-term and long-term.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,true,false,,
12,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,"According to the National Institute on Alcohol Abuse and Alcoholism, binge drinking can cause permanent damage to the brain.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,confusing answer,
89,41_6,What are the short and long-term effects of binge drinking on brain chemicals?,"According to the National Institute on Alcohol Abuse and Alcoholism, binge drinking can cause permanent damage to the brain.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,confusing answer,
11,411_2,What was Charles Kennedy's campaign strategy during the 2005 general election?,"Charles Kennedy extended this strategy at the 2005 General Election targeting the seats held by the most senior and/or highly regarded Conservative MPs, dubbed a decapitation strategy, with the expectation that without these key figures, the Conservatives would be discredited as the Official Opposition allowing the Liberal Democrats to claim that they are the effective Opposition.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,411_2,What was Charles Kennedy's campaign strategy during the 2005 general election?,"Charles Kennedy extended this strategy at the 2005 General Election targeting the seats held by the most senior and/or highly regarded Conservative MPs, dubbed a decapitation strategy, with the expectation that without these key figures, the Conservatives would be discredited as the Official Opposition allowing the Liberal Democrats to claim that they are the effective Opposition.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,411_2,What was Charles Kennedy's campaign strategy during the 2005 general election?,"Charles Kennedy extended this strategy at the 2005 General Election targeting the seats held by the most senior and/or highly regarded Conservative MPs, dubbed a decapitation strategy, with the expectation that without these key figures, the Conservatives would be discredited as the Official Opposition.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
34,411_2,What was Charles Kennedy's campaign strategy during the 2005 general election?,"Charles Kennedy extended this strategy at the 2005 General Election targeting the seats held by the most senior and/or highly regarded Conservative MPs, dubbed a decapitation strategy, with the expectation that without these key figures, the Conservatives would be discredited as the Official Opposition.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
21,411_2,What was Charles Kennedy's campaign strategy during the 2005 general election?,"Charles Kennedy extended this strategy at the 2005 General Election targeting the seats held by the most senior and/or highly regarded Conservative MPs, dubbed a decapitation strategy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
20,411_2,What was Charles Kennedy's campaign strategy during the 2005 general election?,"Charles Kennedy extended this strategy at the 2005 General Election targeting the seats held by the most senior and/or highly regarded Conservative MPs, dubbed a decapitation strategy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,It doesn't answer what the strategy was.,false,true,,
23,412_1,What is the definition of Melungeon?,Melungeon is a racial group in the United States.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,412_1,What is the definition of Melungeon?,Melungeon is a racial group in the United States.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,412_1,What is the definition of Melungeon?,Melungeon is a term used to describe people of mixed African and European ancestry.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,412_1,What is the definition of Melungeon?,Melungeon is a term used to describe people of mixed African and European ancestry.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,412_1,What is the definition of Melungeon?,"Melungeon is a mixed-race, multi-ethnic, multiracial, and intermarried group of people.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
73,412_1,What is the definition of Melungeon?,"Melungeon is a mixed-race, multi-ethnic, multiracial, and intermarried group of people.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
38,412_1,What is the definition of Melungeon?,Melungeon is a term traditionally applied to a group of people who lived in the Southeastern United States between the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,412_1,What is the definition of Melungeon?,Melungeon is a term traditionally applied to a group of people who lived in the Southeastern United States between the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
21,414_1,what is planet jarrett about?,Planet Jarrett was a professional wrestling stable in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,414_1,what is planet jarrett about?,Planet Jarrett was a professional wrestling stable in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,414_1,what is planet jarrett about?,Planet Jarrett is a professional wrestling stable.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
26,414_1,what is planet jarrett about?,Planet Jarrett is a professional wrestling stable.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,414_1,what is planet jarrett about?,Planet Jarrett is a professional wrestling stable in Total Nonstop Action Wrestling (TNA).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,414_1,what is planet jarrett about?,Planet Jarrett is a professional wrestling stable in Total Nonstop Action Wrestling (TNA).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
12,414_1,what is planet jarrett about?,"Jeff Jarrett is the founder and manager of the professional wrestling promotion, Total Nonstop Action (TNA).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
21,414_1,what is planet jarrett about?,"Jeff Jarrett is the founder and manager of the professional wrestling promotion, Total Nonstop Action (TNA).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
7,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Heyerdahl and five fellow adventurers sailed from Peru to the Tuamotu Islands, French Polynesia in a pae-pae raft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Heyerdahl and five fellow adventurers sailed from Peru to the Tuamotu Islands, French Polynesia in a pae-pae raft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
20,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Heyerdahl and adventurers sailed from Peru to the Tuamotu Islands, French Polynesia in a pae-pae raft that they had constructed from balsa wood and other native materials.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
14,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Heyerdahl and adventurers sailed from Peru to the Tuamotu Islands, French Polynesia in a pae-pae raft that they had constructed from balsa wood and other native materials.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Roald Heyerdahl and adventurers sailed from Peru to the Tuamotu Islands, French Polynesia in a pae-pae raft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Roald Heyerdahl and adventurers sailed from Peru to the Tuamotu Islands, French Polynesia in a pae-pae raft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
12,417_3,where all did the Kon-Tiki expedition sail to?,"heyerdahl and five fellow adventurers sailed from peru to the tuamotu islands,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
10,417_3,where all did the Kon-Tiki expedition sail to?,"heyerdahl and five fellow adventurers sailed from peru to the tuamotu islands,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
76,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Heyerdahl and five fellow adventurers sailed from Peru to the Tuamotu Islands, French Polynesia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
15,417_3,where all did the Kon-Tiki expedition sail to?,"In 1947, Heyerdahl and five fellow adventurers sailed from Peru to the Tuamotu Islands, French Polynesia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
4,417_7,who is Thor heyerdahl,Thor Heyerdahl was a Norwegian explorer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
56,417_7,who is Thor heyerdahl,Thor Heyerdahl was a Norwegian explorer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,417_7,who is Thor heyerdahl,"Thor Heyerdahl was a Norwegian physicist, anthropologist, and explorer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
18,417_7,who is Thor heyerdahl,"Thor Heyerdahl was a Norwegian physicist, anthropologist, and explorer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,417_7,who is Thor heyerdahl,Thor Heyerdahl was a Norwegian oceanographer and explorer.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,417_7,who is Thor heyerdahl,Thor Heyerdahl was a Norwegian oceanographer and explorer.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
28,417_7,who is Thor heyerdahl,"Thor Heyerdahl was an American-Norwegian Philosopher, author, and explorer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
62,417_7,who is Thor heyerdahl,"Thor Heyerdahl was an American-Norwegian Philosopher, author, and explorer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
110,42_4,Are there tourism activities related to Bessie Smith in Chattanooga?,The Bessie Smith Performance Hall is the home of the Chattanooga African American Museum and the Bessie Smith Hall.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
33,42_4,Are there tourism activities related to Bessie Smith in Chattanooga?,The Bessie Smith Performance Hall is the home of the Chattanooga African American Museum and the Bessie Smith Hall.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
18,42_4,Are there tourism activities related to Bessie Smith in Chattanooga?,"As a result of an extensive strategic planning process and to generate an overall awareness of what the one entity offers to Chattanooga, surrounding areas, and the southeastern region, the Chattanooga African American Museum/Bessie Smith Performance Hall was the renamed Bessie Smith Cultural Center.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
86,42_4,Are there tourism activities related to Bessie Smith in Chattanooga?,"As a result of an extensive strategic planning process and to generate an overall awareness of what the one entity offers to Chattanooga, surrounding areas, and the southeastern region, the Chattanooga African American Museum/Bessie Smith Performance Hall was the renamed Bessie Smith Cultural Center.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,42_4,Are there tourism activities related to Bessie Smith in Chattanooga?,the chattanooga african american museum / bessie smith performance hall was renamed the bessie smith cultural center ( african american museum & performance hall ) in 2009,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,42_4,Are there tourism activities related to Bessie Smith in Chattanooga?,the chattanooga african american museum / bessie smith performance hall was renamed the bessie smith cultural center ( african american museum & performance hall ) in 2009,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
5,422_1,What did the Béla Fleck and the Flecktones record?,"The Béla Fleck and the Flecktones released their debut album, Béla Fleck and the Flecktones.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
78,422_1,What did the Béla Fleck and the Flecktones record?,"The Béla Fleck and the Flecktones released their debut album, Béla Fleck and the Flecktones.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,422_1,What did the Béla Fleck and the Flecktones record?,Béla Fleck and the Flecktones is the debut studio album by American singer-songwriter Béla Fleck.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,422_1,What did the Béla Fleck and the Flecktones record?,Béla Fleck and the Flecktones is the debut studio album by American singer-songwriter Béla Fleck.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,422_1,What did the Béla Fleck and the Flecktones record?,Béla Fleck and the Flecktones have released five studio albums.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
24,422_1,What did the Béla Fleck and the Flecktones record?,Béla Fleck and the Flecktones have released five studio albums.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,It doesn't state what they recorded.,false,true,,
14,422_2,When was Béla Fleck and the Flecktones debut album released?,"Bela Fleck and the Flecktones' self-titled debut album was released on October 12, 1971.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,422_2,When was Béla Fleck and the Flecktones debut album released?,"Bela Fleck and the Flecktones' self-titled debut album was released on October 12, 1971.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,422_2,When was Béla Fleck and the Flecktones debut album released?,The Flecktones' debut album was released in 1991,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,422_2,When was Béla Fleck and the Flecktones debut album released?,The Flecktones' debut album was released in 1991,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
8,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones is the first studio album by the band Béla Fleck and the Flecktones, released in 1990.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
22,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones is the first studio album by the band Béla Fleck and the Flecktones, released in 1990.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
3,422_2,When was Béla Fleck and the Flecktones debut album released?,Béla Fleck and the Flecktones' debut album was released in 1990.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,422_2,When was Béla Fleck and the Flecktones debut album released?,Béla Fleck and the Flecktones' debut album was released in 1990.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
7,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones' debut album, Flight of the Cosmic Hippo, was released in 1990.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones' debut album, Flight of the Cosmic Hippo, was released in 1990.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
34,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones (album) - Wikipedia CentralNotice Béla Fleck and the Flecktones (album) From Wikipedia, the free encyclopedia Jump to navigation Jump to search 1990 studio album by Béla Fleck and the Flecktones Béla Fleck and the Flecktones Studio album by Béla Fleck and the Flecktones Released March 6, 1990 Recorded 1989, Javelina Studios Genre Jazz fusion , bluegrass , post-bop , neofolk Length 47 : 56 Label Warner Bros. Producer Béla Fleck with the Flecktones Béla Fleck and the Flecktones chronology Béla Fleck and the Flecktones (1990) Flight of the Cosmic Hippo (1991) Béla Fleck and the Flecktones is the first album by the band of the same name , released in 1990.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
8,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones (album) - Wikipedia CentralNotice Béla Fleck and the Flecktones (album) From Wikipedia, the free encyclopedia Jump to navigation Jump to search 1990 studio album by Béla Fleck and the Flecktones Béla Fleck and the Flecktones Studio album by Béla Fleck and the Flecktones Released March 6, 1990 Recorded 1989, Javelina Studios Genre Jazz fusion , bluegrass , post-bop , neofolk Length 47 : 56 Label Warner Bros. Producer Béla Fleck with the Flecktones Béla Fleck and the Flecktones chronology Béla Fleck and the Flecktones (1990) Flight of the Cosmic Hippo (1991) Béla Fleck and the Flecktones is the first album by the band of the same name , released in 1990.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
8,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones' self-titled debut album was released on October 26, 2001.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones' self-titled debut album was released on October 26, 2001.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones is the first studio album by Béla Fleck and the Flecktones, released in 1990.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
3,422_2,When was Béla Fleck and the Flecktones debut album released?,"Béla Fleck and the Flecktones is the first studio album by Béla Fleck and the Flecktones, released in 1990.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
6,425_1,What is Get 'Em Girls?,Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
74,425_1,What is Get 'Em Girls?,Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,425_1,What is Get 'Em Girls?,Get 'Em Girls is the second studio album by American singer Jessica Mauboy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
18,425_1,What is Get 'Em Girls?,Get 'Em Girls is the second studio album by American singer Jessica Mauboy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
18,425_1,What is Get 'Em Girls?,"Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy, released on 5 November 2010 by Sony Music Australia.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,425_1,What is Get 'Em Girls?,"Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy, released on 5 November 2010 by Sony Music Australia.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,429_4,"Was the Powderfinger song, My Happiness a success?","Powderfinger song, My Happiness peaked at number two on the UK Singles Chart.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
37,429_4,"Was the Powderfinger song, My Happiness a success?","Powderfinger song, My Happiness peaked at number two on the UK Singles Chart.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,429_4,"Was the Powderfinger song, My Happiness a success?","Powderfinger song, My Happiness peaked at No. 3 on the UK Singles Chart.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,429_4,"Was the Powderfinger song, My Happiness a success?","Powderfinger song, My Happiness peaked at No. 3 on the UK Singles Chart.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,429_4,"Was the Powderfinger song, My Happiness a success?","My Happiness peaked at number four on the Australian ARIA Singles Chart, and charted in the United States on the Hot Modern Rock Tracks chart—the first Powderfinger song to do so.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,429_4,"Was the Powderfinger song, My Happiness a success?","My Happiness peaked at number four on the Australian ARIA Singles Chart, and charted in the United States on the Hot Modern Rock Tracks chart—the first Powderfinger song to do so.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
18,429_5,"Did Powderfinder get any awards for their single, My Happiness?","At the ARIA Awards ceremony, My Happiness won Single of the Year.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
21,429_5,"Did Powderfinder get any awards for their single, My Happiness?","At the ARIA Awards ceremony, My Happiness won Single of the Year.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
22,429_5,"Did Powderfinder get any awards for their single, My Happiness?",The song My Happiness won the APRA Award for Hottest Single of 2001.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
22,429_5,"Did Powderfinder get any awards for their single, My Happiness?",The song My Happiness won the APRA Award for Hottest Single of 2001.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,429_5,"Did Powderfinder get any awards for their single, My Happiness?",If It Makes You Happy won the Single of the Year award at the ARIA Awards of 2001 and the 2001 Song of the Year APRA Award.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
19,429_5,"Did Powderfinder get any awards for their single, My Happiness?",If It Makes You Happy won the Single of the Year award at the ARIA Awards of 2001 and the 2001 Song of the Year APRA Award.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,429_5,"Did Powderfinder get any awards for their single, My Happiness?",The song won the Single of the Year award at the ARIA Awards of 2001,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,429_5,"Did Powderfinder get any awards for their single, My Happiness?",The song won the Single of the Year award at the ARIA Awards of 2001,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,43_5,What is the South Pond Nature Area in Ann Arbor?,"South Pond Nature Area is a nature preserve in Ann Arbor, Michigan.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,43_5,What is the South Pond Nature Area in Ann Arbor?,"South Pond Nature Area is a nature preserve in Ann Arbor, Michigan.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a nature area in Ann Arbor.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,true,false,correct answer,
76,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a nature area in Ann Arbor.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,random answer,
13,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a 16-acre park located north of Huron River Drive and south of the Gallup Park bike trail.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
9,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a 16-acre park located north of Huron River Drive and south of the Gallup Park bike trail.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,confusing answer,
78,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a nature preserve located in Ann Arbor.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a nature preserve located in Ann Arbor.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
51,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a nature preserve in Ann Arbor.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
21,43_5,What is the South Pond Nature Area in Ann Arbor?,South Pond Nature Area is a nature preserve in Ann Arbor.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,431_12,Was Ryan Dunn's Welcome to the Bates Motel released?,Welcome to the Bates Motel was released in 2013.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
29,431_12,Was Ryan Dunn's Welcome to the Bates Motel released?,Welcome to the Bates Motel was released in 2013.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,431_12,Was Ryan Dunn's Welcome to the Bates Motel released?,The film was later renamed The Bates Haunting and was released in 2013.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
45,431_12,Was Ryan Dunn's Welcome to the Bates Motel released?,The film was later renamed The Bates Haunting and was released in 2013.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
17,431_12,Was Ryan Dunn's Welcome to the Bates Motel released?,The film Welcome to the Bates Motel was released in 2013.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,431_12,Was Ryan Dunn's Welcome to the Bates Motel released?,The film Welcome to the Bates Motel was released in 2013.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,431_6,When was Ryan Dunn's The Jackass 3D released?,"Ryan Dunn's The Jackass 3D was released on November 9, 2012.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,431_6,When was Ryan Dunn's The Jackass 3D released?,"Ryan Dunn's The Jackass 3D was released on November 9, 2012.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,431_6,When was Ryan Dunn's The Jackass 3D released?,"Paramount Pictures released The Jackass 3D on October 15, 2010.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,431_6,When was Ryan Dunn's The Jackass 3D released?,"Paramount Pictures released The Jackass 3D on October 15, 2010.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,431_6,When was Ryan Dunn's The Jackass 3D released?,"Jackass 3D was released on October 15, 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,431_6,When was Ryan Dunn's The Jackass 3D released?,"Jackass 3D was released on October 15, 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,431_6,When was Ryan Dunn's The Jackass 3D released?,"Paramount Pictures released the film Jackass 3D on October 15, 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
23,431_6,When was Ryan Dunn's The Jackass 3D released?,"Paramount Pictures released the film Jackass 3D on October 15, 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,431_6,When was Ryan Dunn's The Jackass 3D released?,"Jackass 3D was released on October 25, 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
91,431_6,When was Ryan Dunn's The Jackass 3D released?,"Jackass 3D was released on October 25, 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
21,431_6,When was Ryan Dunn's The Jackass 3D released?,"Ryan Dunn's The Jackass 3D was released on November 14, 2012.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,431_6,When was Ryan Dunn's The Jackass 3D released?,"Ryan Dunn's The Jackass 3D was released on November 14, 2012.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's Proving Ground, premiered on September 25, 2012.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's Proving Ground, premiered on September 25, 2012.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn co-hosted G4's Proving Ground made its premiere on June 14, 2011, six days before his death.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
112,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn co-hosted G4's Proving Ground made its premiere on June 14, 2011, six days before his death.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","The show, G4's Proving Ground premiered on June 14, 2011.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","The show, G4's Proving Ground premiered on June 14, 2011.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's proving ground premiered on September 25, 2012.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's proving ground premiered on September 25, 2012.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
17,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's Proving Ground started on June 14, 2006.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's Proving Ground started on June 14, 2006.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's Proving Ground premiered on June 14, 2011.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,431_8,"When did Ryan Dunn's show, G4's Proving Ground start?","Ryan Dunn's show, G4's Proving Ground premiered on June 14, 2011.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,434_5,"How did the band, Skyhooks shock middle Australia?","The band, Skyhooks shocked middle Australia with their live performances.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,434_5,"How did the band, Skyhooks shock middle Australia?","The band, Skyhooks shocked middle Australia with their live performances.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,434_5,"How did the band, Skyhooks shock middle Australia?","The band, Skyhooks shocked middle Australia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
60,434_5,"How did the band, Skyhooks shock middle Australia?","The band, Skyhooks shocked middle Australia.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
6,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that depicted frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked middle-aged Australia with their outrageous costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
20,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that depicted frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked middle-aged Australia with their outrageous costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented depictions of the social life of young Australia in the 1970s, the band shocked conservative middle Australia with their outrageous (for the time) costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented depictions of the social life of young Australia in the 1970s, the band shocked conservative middle Australia with their outrageous (for the time) costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked conservative middle Australia with their outrageous costumes, make-up, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked conservative middle Australia with their outrageous costumes, make-up, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, the band shocked conservative middle Australia with their outrageous (for the time) costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, the band shocked conservative middle Australia with their outrageous (for the time) costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, the band shocked conservative middle Australia with their outrageous costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, the band shocked conservative middle Australia with their outrageous costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
2,434_5,"How did the band, Skyhooks shock middle Australia?",the band shocked conservative middle australia with their outrageous ( for the time ) costumes,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
96,434_5,"How did the band, Skyhooks shock middle Australia?",the band shocked conservative middle australia with their outrageous ( for the time ) costumes,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
21,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked middle Australia with their outrageous costumes, make-up, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
14,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked middle Australia with their outrageous costumes, make-up, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
6,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that depicted frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked middle Australia with their outrageous costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
47,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that depicted frank depictions of the social life of young Australia in the 1970s, Skyhooks shocked middle Australia with their outrageous costumes, make-up, lyrics, and on-stage activities.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, the band, Skyhooks shocked conservative middle Australia with their outrageous costumes, make-up, and on-stage activities.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,434_5,"How did the band, Skyhooks shock middle Australia?","Adopting elements of glam rock in their presentation, and lyrics that presented frank depictions of the social life of young Australia in the 1970s, the band, Skyhooks shocked conservative middle Australia with their outrageous costumes, make-up, and on-stage activities.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,434_6,"Did the band, Skyhooks release any albums in the 70s?","Skyhooks had #1 albums on the Australian Kent Music Report with their 1974 debut, Living in the 70's, and its follow-up, Ego Is Not a Dirty Word (11 weeks).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,434_6,"Did the band, Skyhooks release any albums in the 70s?","Skyhooks had #1 albums on the Australian Kent Music Report with their 1974 debut, Living in the 70's, and its follow-up, Ego Is Not a Dirty Word (11 weeks).",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
25,434_6,"Did the band, Skyhooks release any albums in the 70s?",skyhooks had # 1 albums on the australian kent music report with their 1974 debut,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,434_6,"Did the band, Skyhooks release any albums in the 70s?",skyhooks had # 1 albums on the australian kent music report with their 1974 debut,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
5,434_6,"Did the band, Skyhooks release any albums in the 70s?","Skyhooks had #1 albums on the Australian Kent Music Report with their 1974 debut, Living in the 70's, and its 1975 follow-up, Ego Is Not a Dirty Word.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
58,434_6,"Did the band, Skyhooks release any albums in the 70s?","Skyhooks had #1 albums on the Australian Kent Music Report with their 1974 debut, Living in the 70's, and its 1975 follow-up, Ego Is Not a Dirty Word.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,436_2,Who were J. C. Watts' parents?,"J. C. Watts was born in Eufaula in McIntosh County, Oklahoma to J. C. Buddy Watts Sr., and Helen Watts.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
100,436_2,Who were J. C. Watts' parents?,"J. C. Watts was born in Eufaula in McIntosh County, Oklahoma to J. C. Buddy Watts Sr., and Helen Watts.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
65,436_2,Who were J. C. Watts' parents?,J. C. Watts' parents were John C. Watts and Elizabeth Ann Bowen,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,Elizabeth Ann Bowen is not his mother.,false,true,,
4,436_2,Who were J. C. Watts' parents?,J. C. Watts' parents were John C. Watts and Elizabeth Ann Bowen,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,436_2,Who were J. C. Watts' parents?,J. C. Watts' parents were John C. Watts and Helen Stubblefield.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,436_2,Who were J. C. Watts' parents?,J. C. Watts' parents were John C. Watts and Helen Stubblefield.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,436_2,Who were J. C. Watts' parents?,J. C. Watts' parents were William and Mary Watts.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
41,436_2,Who were J. C. Watts' parents?,J. C. Watts' parents were William and Mary Watts.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
37,438_5,Did Jason Giambi and The Colorado Rockies get the Wild Card?,The Colorado Rockies won the National League Wild Card in 2009.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
23,438_5,Did Jason Giambi and The Colorado Rockies get the Wild Card?,The Colorado Rockies won the National League Wild Card in 2009.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
38,438_5,Did Jason Giambi and The Colorado Rockies get the Wild Card?,"The 2009 Colorado Rockies won their third Wild Card title, and second in three years.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,438_5,Did Jason Giambi and The Colorado Rockies get the Wild Card?,"The 2009 Colorado Rockies won their third Wild Card title, and second in three years.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
20,438_5,Did Jason Giambi and The Colorado Rockies get the Wild Card?,"The Colorado Rockies came back to win their third Wild Card title, and second in three years.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
60,438_5,Did Jason Giambi and The Colorado Rockies get the Wild Card?,"The Colorado Rockies came back to win their third Wild Card title, and second in three years.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
16,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?","Ronald Reagan's film, Hollywood Hotel was released in 1973.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?","Ronald Reagan's film, Hollywood Hotel was released in 1973.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?","Ronald Reagan's film, Hollywood Hotel was released in 1940.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?","Ronald Reagan's film, Hollywood Hotel was released in 1940.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?","The film, Hollywood Hotel was released in 1937.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?","The film, Hollywood Hotel was released in 1937.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?",Hollywood Hotel was released in 1937.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,439_7,"What year was Ronald Reagan's film, Hollywood Hotel released?",Hollywood Hotel was released in 1937.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,441_8,What happened with Billy Corgan's solo career?,Billy Corgan's solo career began with the release of his self-titled debut album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,441_8,What happened with Billy Corgan's solo career?,Billy Corgan's solo career began with the release of his self-titled debut album.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
4,441_8,What happened with Billy Corgan's solo career?,"Billy Corgan's solo career began with the release of his debut solo album, Billy Corgan.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,441_8,What happened with Billy Corgan's solo career?,"Billy Corgan's solo career began with the release of his debut solo album, Billy Corgan.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,441_8,What happened with Billy Corgan's solo career?,"Billy Corgan began a solo music career, landing on an electronic / shoegaze / alternative rock sound for his first solo album, TheFutureEmbrace.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,441_8,What happened with Billy Corgan's solo career?,"Billy Corgan began a solo music career, landing on an electronic / shoegaze / alternative rock sound for his first solo album, TheFutureEmbrace.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,442_4,How was Nawaz Sharif's family life?,Nawaz Sharif was born in Lahore.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
45,442_4,How was Nawaz Sharif's family life?,Nawaz Sharif was born in Lahore.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
4,442_4,How was Nawaz Sharif's family life?,"Nawaz Sharif's father was a Pakistani businessman and father of Nawaz Sharif and his mother was Shamim Akhtar, a housewife and mother of Nawaz and Shabaz Sharif.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,442_4,How was Nawaz Sharif's family life?,"Nawaz Sharif's father was a Pakistani businessman and father of Nawaz Sharif and his mother was Shamim Akhtar, a housewife and mother of Nawaz and Shabaz Sharif.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
8,442_4,How was Nawaz Sharif's family life?,"Nawaz Sharif's father, Muhammad Sharif, was a Pakistani businessman and father of Nawaz Sharif and Shabaz Sharif. Shamim Akhtar, wife Muhammad Sharif, and mother of Nawaz and Shabaz Sharif.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,442_4,How was Nawaz Sharif's family life?,"Nawaz Sharif's father, Muhammad Sharif, was a Pakistani businessman and father of Nawaz Sharif and Shabaz Sharif. Shamim Akhtar, wife Muhammad Sharif, and mother of Nawaz and Shabaz Sharif.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,449_1,What is the origin of the Etruscan civilization?,There are three main hypotheses as to the origins of the Etruscan civilization in the Early Iron Age. Autochthonous development in situ out of the Villanovan culture.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,449_1,What is the origin of the Etruscan civilization?,There are three main hypotheses as to the origins of the Etruscan civilization in the Early Iron Age. Autochthonous development in situ out of the Villanovan culture.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,449_1,What is the origin of the Etruscan civilization?,"The Etruscan civilization, regarded as the oldest phase of the Iron Age, begins with the Villanovan culture.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
3,449_1,What is the origin of the Etruscan civilization?,"The Etruscan civilization, regarded as the oldest phase of the Iron Age, begins with the Villanovan culture.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,449_1,What is the origin of the Etruscan civilization?,"The origin of the Etruscan civilization is a complex question that involves three main hypotheses: a migration from the sea, an autochthonous population that diverged from the Villanovan culture, and a Tyrsenian language family.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,449_1,What is the origin of the Etruscan civilization?,"The origin of the Etruscan civilization is a complex question that involves three main hypotheses: a migration from the sea, an autochthonous population that diverged from the Villanovan culture, and a Tyrsenian language family.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,449_1,What is the origin of the Etruscan civilization?,The Etruscan civilization began in the Late Bronze Age.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
55,449_1,What is the origin of the Etruscan civilization?,The Etruscan civilization began in the Late Bronze Age.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
13,45_7,How much does a Irish Wolfhound weigh?,The average Irish wolfhound weighs between 10 and 15 pounds.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,45_7,How much does a Irish Wolfhound weigh?,The average Irish wolfhound weighs between 10 and 15 pounds.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,45_7,How much does a Irish Wolfhound weigh?,A male Irish Wolfhound normally weights between 120 and 145 pounds. A female Irish Wolfhound normally weights between 105 and 110 pounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,random answer,
19,45_7,How much does a Irish Wolfhound weigh?,A male Irish Wolfhound normally weights between 120 and 145 pounds. A female Irish Wolfhound normally weights between 105 and 110 pounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
34,45_7,How much does a Irish Wolfhound weigh?,A Wolfhound weighs about 4 pounds and has a maximum of 7 pounds. The average weight for a Irish Wolfhound is between 12 and 9 pounds,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,confusing answer,
91,45_7,How much does a Irish Wolfhound weigh?,A Wolfhound weighs about 4 pounds and has a maximum of 7 pounds. The average weight for a Irish Wolfhound is between 12 and 9 pounds,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,confusing answer,
12,45_7,How much does a Irish Wolfhound weigh?,A male Irish Wolfhound weighs 120 pounds and a female Irish Wolfhound weighs 105 pounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
31,45_7,How much does a Irish Wolfhound weigh?,A male Irish Wolfhound weighs 120 pounds and a female Irish Wolfhound weighs 105 pounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
62,45_7,How much does a Irish Wolfhound weigh?,The average weight of an Irish Wolfhound is 120 pounds.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,true,false,random answer,
63,45_7,How much does a Irish Wolfhound weigh?,The average weight of an Irish Wolfhound is 120 pounds.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,45_7,How much does a Irish Wolfhound weigh?,The average Irish Wolfhound weighs about 69 kg.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
13,45_7,How much does a Irish Wolfhound weigh?,The average Irish Wolfhound weighs about 69 kg.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,45_7,How much does a Irish Wolfhound weigh?,"The Irish wolfhound is a medium-sized, medium-to-large sized dog, weighing between 10 and 15 pounds.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
116,45_7,How much does a Irish Wolfhound weigh?,"The Irish wolfhound is a medium-sized, medium-to-large sized dog, weighing between 10 and 15 pounds.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
95,45_7,How much does a Irish Wolfhound weigh?,The average adult male Irish Wolfhound weighs about 120 pounds and female is about 105 pounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,random answer,
12,45_7,How much does a Irish Wolfhound weigh?,The average adult male Irish Wolfhound weighs about 120 pounds and female is about 105 pounds.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,right answer,false,false,,
11,45_8,How much do Irish Wolfhounds cost?,"Irish wolfhounds can be purchased for £1,500.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,right answer,false,false,,
14,45_8,How much do Irish Wolfhounds cost?,"Irish wolfhounds can be purchased for £1,500.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
109,45_8,How much do Irish Wolfhounds cost?,"The average cost for all Irish Wolfhounds sold is $1,300.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
22,45_8,How much do Irish Wolfhounds cost?,"The average cost for all Irish Wolfhounds sold is $1,300.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
35,45_8,How much do Irish Wolfhounds cost?,"The average price for Wolfhounds is between $1 and $35,530 per year.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,positive one,false,false,confusing answer,
15,45_8,How much do Irish Wolfhounds cost?,"The average price for Wolfhounds is between $1 and $35,530 per year.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,confusing answer,
37,45_8,How much do Irish Wolfhounds cost?,"The current median price for all Irish Wolfhounds sold is $1,375.00.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
108,45_8,How much do Irish Wolfhounds cost?,"The current median price for all Irish Wolfhounds sold is $1,375.00.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,45_8,How much do Irish Wolfhounds cost?,"the current median price for all irish wolfhounds sold is $ 1, 375. 00",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
8,45_8,How much do Irish Wolfhounds cost?,"the current median price for all irish wolfhounds sold is $ 1, 375. 00",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
12,45_8,How much do Irish Wolfhounds cost?,"The average cost of an Irish Wolfhound puppy is $1,300. The current median price for all Irish Wolfhound puppies sold is $1,375. This is the price you can expect to budget for an Irish Wolfhound with papers but without breeding rights nor show quality.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
21,45_8,How much do Irish Wolfhounds cost?,"The average cost of an Irish Wolfhound puppy is $1,300. The current median price for all Irish Wolfhound puppies sold is $1,375. This is the price you can expect to budget for an Irish Wolfhound with papers but without breeding rights nor show quality.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
13,451_1,What national team was Vlade Divac in?,"Vlade Divac played for the senior Yugoslavia national basketball team at the 1986 FIBA World Championship in Madrid, on invitation by the head coach Kreimir osi.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,451_1,What national team was Vlade Divac in?,"Vlade Divac played for the senior Yugoslavia national basketball team at the 1986 FIBA World Championship in Madrid, on invitation by the head coach Kreimir osi.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,451_1,What national team was Vlade Divac in?,"Vlade Divac debuted for the senior Yugoslavia national basketball team at the 1986 FIBA World Championship in Madrid, on invitation by the head coach Kreimir osi.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
19,451_1,What national team was Vlade Divac in?,"Vlade Divac debuted for the senior Yugoslavia national basketball team at the 1986 FIBA World Championship in Madrid, on invitation by the head coach Kreimir osi.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
5,451_1,What national team was Vlade Divac in?,Vlade Divac was in the Yugoslav national basketball team.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
7,451_1,What national team was Vlade Divac in?,Vlade Divac was in the Yugoslav national basketball team.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
19,452_1,What is one example of the controversies about Gary Oldman?,"Following his Friends appearance, Gary Oldman did not appear in any major roles until 2004; it was suggested that he was blacklisted in Hollywood during this time.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,452_1,What is one example of the controversies about Gary Oldman?,"Following his Friends appearance, Gary Oldman did not appear in any major roles until 2004; it was suggested that he was blacklisted in Hollywood during this time.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
8,452_1,What is one example of the controversies about Gary Oldman?,"Following his Friends appearance, Oldman did not appear in any major roles until 2004; it was suggested that he was blacklisted in Hollywood during this time, following the controversy that had surrounded the release of The Contender.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
77,452_1,What is one example of the controversies about Gary Oldman?,"Following his Friends appearance, Oldman did not appear in any major roles until 2004; it was suggested that he was blacklisted in Hollywood during this time, following the controversy that had surrounded the release of The Contender.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,452_1,What is one example of the controversies about Gary Oldman?,"Career slump (2002–2003) [ edit ] Oldman at the 2009 San Diego Comic-Con International Following his Friends appearance, Oldman did not appear in any major roles until 2004; it was suggested that he was blacklisted in Hollywood during this time, [56] following the controversy that had surrounded the release of The Contender .",simple-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-20-21-01-58,true,,false,false,,
20,452_1,What is one example of the controversies about Gary Oldman?,"Career slump (2002–2003) [ edit ] Oldman at the 2009 San Diego Comic-Con International Following his Friends appearance, Oldman did not appear in any major roles until 2004; it was suggested that he was blacklisted in Hollywood during this time, [56] following the controversy that had surrounded the release of The Contender .",simple-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-20-21-01-58,false,,false,true,,
11,453_3,Has Gary Oldman's recent work earned any awards?,Gary Oldman won the Academy Award for Best Actor for his performance in Darkest Hour.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,453_3,Has Gary Oldman's recent work earned any awards?,Gary Oldman won the Academy Award for Best Actor for his performance in Darkest Hour.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,453_3,Has Gary Oldman's recent work earned any awards?,"Gary Oldman won an Academy Award for Best Actor for Tinker, Tailor, Soldier, Spy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,453_3,Has Gary Oldman's recent work earned any awards?,"Gary Oldman won an Academy Award for Best Actor for Tinker, Tailor, Soldier, Spy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,453_3,Has Gary Oldman's recent work earned any awards?,Gary Oldman's work has earned him an Academy Award for Best Actor.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,453_3,Has Gary Oldman's recent work earned any awards?,Gary Oldman's work has earned him an Academy Award for Best Actor.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,453_3,Has Gary Oldman's recent work earned any awards?,"Gary Oldman has won an Academy Award for Best Actor for his performance in Tinker, Tailor, Soldier, Spy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
7,453_3,Has Gary Oldman's recent work earned any awards?,"Gary Oldman has won an Academy Award for Best Actor for his performance in Tinker, Tailor, Soldier, Spy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
28,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","Gary Oldman earned the Academy Award for Best Actor, Golden Globe award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
16,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","Gary Oldman earned the Academy Award for Best Actor, Golden Globe award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
41,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?",Gary Oldman earned the Academy Award for Best Actor in a Leading Role in a Dramatic Film in 2010.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?",Gary Oldman earned the Academy Award for Best Actor in a Leading Role in a Dramatic Film in 2010.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?",Oldman earned the Academy Award for Best Supporting Actor for his work in the film,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,,
38,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?",Oldman earned the Academy Award for Best Supporting Actor for his work in the film,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,,
8,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","Gary Oldman won the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Supporting Actor in a Limited Series or a Movie.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
11,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","Gary Oldman won the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Supporting Actor in a Limited Series or a Movie.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
8,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","Gary Oldman won the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor in a Motion Picture.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","Gary Oldman won the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor in a Motion Picture.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
15,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?",Gary Oldman was nominated for the Academy Award for Best Supporting Actor for his performance in Gary Oldman.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
4,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?",Gary Oldman was nominated for the Academy Award for Best Supporting Actor for his performance in Gary Oldman.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","In 2018, Gary Oldman won the Academy Award for Best Actor.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,453_4,"What year did Gary Oldman earn the Academy Award for Best Actor, Golden Globe Award for Best Actor – Motion Picture Drama, and Critics' Choice Movie Award for Best Actor?","In 2018, Gary Oldman won the Academy Award for Best Actor.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,454_1,When was Corey Taylor born?,"Corey Taylor was born on November 14, 1976.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,454_1,When was Corey Taylor born?,"Corey Taylor was born on November 14, 1976.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,454_1,When was Corey Taylor born?,"Corey Taylor was born on October 24, 1971.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,454_1,When was Corey Taylor born?,"Corey Taylor was born on October 24, 1971.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,454_1,When was Corey Taylor born?,"Corey Todd Taylor was born on December 8, 1973 in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,454_1,When was Corey Taylor born?,"Corey Todd Taylor was born on December 8, 1973 in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,454_1,When was Corey Taylor born?," Corey Taylor was born on January 17, 1970.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
45,454_1,When was Corey Taylor born?," Corey Taylor was born on January 17, 1970.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
25,454_1,When was Corey Taylor born?,Corey Taylor was born on 8 December 1973.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,454_1,When was Corey Taylor born?,Corey Taylor was born on 8 December 1973.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
25,454_2,Where was Corey Taylor born?,"Corey Taylor was born in Chicago, Illinois.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,454_2,Where was Corey Taylor born?,"Corey Taylor was born in Chicago, Illinois.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,454_2,Where was Corey Taylor born?," Corey Taylor was born in Des Moines, Iowa.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
50,454_2,Where was Corey Taylor born?," Corey Taylor was born in Des Moines, Iowa.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
105,454_2,Where was Corey Taylor born?,"Corey Taylor was born in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,454_2,Where was Corey Taylor born?,"Corey Taylor was born in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,459_2,what else did George W.H. Bush do in 1980 besides becoming chairman on the Executive Committee of the First International Bank in Houston?,George W. H. Bush also spent a year as a part-time professor of Administrative Science at Rice University's Jones School of Business.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,459_2,what else did George W.H. Bush do in 1980 besides becoming chairman on the Executive Committee of the First International Bank in Houston?,George W. H. Bush also spent a year as a part-time professor of Administrative Science at Rice University's Jones School of Business.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,459_2,what else did George W.H. Bush do in 1980 besides becoming chairman on the Executive Committee of the First International Bank in Houston?,"[ 81 ] he also spent a year as a part - time professor of administrative science at rice university's jones school of business,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
30,459_2,what else did George W.H. Bush do in 1980 besides becoming chairman on the Executive Committee of the First International Bank in Houston?,"[ 81 ] he also spent a year as a part - time professor of administrative science at rice university's jones school of business,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,459_2,what else did George W.H. Bush do in 1980 besides becoming chairman on the Executive Committee of the First International Bank in Houston?,"George W.H. Bush also spent a year as a part-time professor of Administrative Science at Rice University's Jones School of Business, and joined the Trilateral Commission.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
57,459_2,what else did George W.H. Bush do in 1980 besides becoming chairman on the Executive Committee of the First International Bank in Houston?,"George W.H. Bush also spent a year as a part-time professor of Administrative Science at Rice University's Jones School of Business, and joined the Trilateral Commission.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
63,46_5,Is Norwegian easier to learn than Spanish?,Norwegian is easier to learn than Spanish.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,46_5,Is Norwegian easier to learn than Spanish?,Norwegian is easier to learn than Spanish.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,positive one,false,false,,
15,46_5,Is Norwegian easier to learn than Spanish?,It's much easier to learn Norwegian than Spanish....Swe,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,positive one,false,false,malformed answer,
17,46_5,Is Norwegian easier to learn than Spanish?,It's much easier to learn Norwegian than Spanish....Swe,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
108,46_5,Is Norwegian easier to learn than Spanish?,"Yes, learning Norwegian is easier than Spanish.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,confusing answer,
50,46_5,Is Norwegian easier to learn than Spanish?,"Yes, learning Norwegian is easier than Spanish.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,confusing answer,
11,46_5,Is Norwegian easier to learn than Spanish?,"Norwegian is easier to learn than Spanish. The grammar is easier to figure out and the phonological system is much easier. Also, Latvian has lost many archaic features that Lithuanian has retained.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,true,false,confusing answer,
14,46_5,Is Norwegian easier to learn than Spanish?,"Norwegian is easier to learn than Spanish. The grammar is easier to figure out and the phonological system is much easier. Also, Latvian has lost many archaic features that Lithuanian has retained.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,right answer,false,false,confusing answer,
18,46_6,What other languages are closest to Norwegian?,Danish is largely mutually intelligible with Norwegian and Swedish.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
113,46_6,What other languages are closest to Norwegian?,Danish is largely mutually intelligible with Norwegian and Swedish.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
79,46_6,What other languages are closest to Norwegian?,"The reason Norwegian occupies a middle position in terms of intelligibility is because of its shared border with Sweden resulting in a similarity in pronunciation, combined with the long tradition of having Danish as a written language.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,confusing answer,
30,46_6,What other languages are closest to Norwegian?,"The reason Norwegian occupies a middle position in terms of intelligibility is because of its shared border with Sweden resulting in a similarity in pronunciation, combined with the long tradition of having Danish as a written language.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
4,46_6,What other languages are closest to Norwegian?," Other languages that are close to Norwegian are Swedish, Danish, and Icelandic.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
54,46_6,What other languages are closest to Norwegian?," Other languages that are close to Norwegian are Swedish, Danish, and Icelandic.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,46_7,Describe some of Norwegian's similarities with Danish.,"The main difference between Danish and Norwegian is the spelling of and pronunciation of words - the words are the same words, just spelled very slightly differently.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,positive one,false,false,confusing answer,
10,46_7,Describe some of Norwegian's similarities with Danish.,"The main difference between Danish and Norwegian is the spelling of and pronunciation of words - the words are the same words, just spelled very slightly differently.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,confusing answer,
7,46_7,Describe some of Norwegian's similarities with Danish.,Norwegian and Danish are both Germanic languages.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
87,46_7,Describe some of Norwegian's similarities with Danish.,Norwegian and Danish are both Germanic languages.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
21,46_7,Describe some of Norwegian's similarities with Danish.,"Norwegian and Danish are the two most similar languages in Europe, and this is likely to be the reason why the languages are so similar. Finnish is a language that is very different from them, due to its origin in the Eastern European countries.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,confusing answer,
11,46_7,Describe some of Norwegian's similarities with Danish.,"Norwegian and Danish are the two most similar languages in Europe, and this is likely to be the reason why the languages are so similar. Finnish is a language that is very different from them, due to its origin in the Eastern European countries.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,confusing answer,
106,46_7,Describe some of Norwegian's similarities with Danish.,"The two most similar languages are Danish and Norwegian. Norway was once under Denmark, and this is likely to be the reason why the languages are so similar. Finnish is a language that is very different from them, due to its origin in the Eastern European countries.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
66,46_7,Describe some of Norwegian's similarities with Danish.,"The two most similar languages are Danish and Norwegian. Norway was once under Denmark, and this is likely to be the reason why the languages are so similar. Finnish is a language that is very different from them, due to its origin in the Eastern European countries.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
13,46_9,How is Germanic related to Old Norse?,German is the language of Old Norse.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
13,46_9,How is Germanic related to Old Norse?,German is the language of Old Norse.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
92,46_9,How is Germanic related to Old Norse?,"Norse is the only language in the world that is related to the Old Norse. As such, the name ""Norse"" is used to describe the",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
56,46_9,How is Germanic related to Old Norse?,"Norse is the only language in the world that is related to the Old Norse. As such, the name ""Norse"" is used to describe the",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
110,46_9,How is Germanic related to Old Norse?,"By the eighth century, the common Germanic language of Scandinavia, (1)-Norse, had undergone some changes and evolved into Old Norse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,confusing answer,
24,46_9,How is Germanic related to Old Norse?,"By the eighth century, the common Germanic language of Scandinavia, (1)-Norse, had undergone some changes and evolved into Old Norse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,good,false,false,confusing answer,
19,46_9,How is Germanic related to Old Norse?,"The Scandinavians, or Norsemen, spoke dialects of a North Germanic language known as Old Norse.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
32,46_9,How is Germanic related to Old Norse?,"The Scandinavians, or Norsemen, spoke dialects of a North Germanic language known as Old Norse.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
96,46_9,How is Germanic related to Old Norse?,Old Norse is a descendant of Proto-Germanic.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
45,46_9,How is Germanic related to Old Norse?,Old Norse is a descendant of Proto-Germanic.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
97,46_9,How is Germanic related to Old Norse?,spoke dialects of a north germanic language known as old norse.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
13,46_9,How is Germanic related to Old Norse?,spoke dialects of a north germanic language known as old norse.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,positive one,false,false,,
25,46_9,How is Germanic related to Old Norse?,"By the eighth century, the common Germanic language of Scandinavia, Proto-Norse, had undergone some changes and evolved into Old Norse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
11,46_9,How is Germanic related to Old Norse?,"By the eighth century, the common Germanic language of Scandinavia, Proto-Norse, had undergone some changes and evolved into Old Norse.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
18,46_9,How is Germanic related to Old Norse?,Scandinavian influence [ edit ] The approximate extent of Old Norse and related languages in the early 10th century: Old West Norse dialect Old East Norse dialect Old Gutnish Old English Crimean Gothic Other Germanic languages with which Old Norse still retained some mutual intelligibility Vikings from modern-day Norway and Denmark began to raid parts of Britain from the late 8th century onward.,simple-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-20-21-01-58,true,,false,false,,
25,46_9,How is Germanic related to Old Norse?,Scandinavian influence [ edit ] The approximate extent of Old Norse and related languages in the early 10th century: Old West Norse dialect Old East Norse dialect Old Gutnish Old English Crimean Gothic Other Germanic languages with which Old Norse still retained some mutual intelligibility Vikings from modern-day Norway and Denmark began to raid parts of Britain from the late 8th century onward.,simple-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-20-21-01-58,true,,false,false,,
18,460_2,Did Gary Ablett's family play australian football too?,"Gary Ablett's brothers played in the Victorian Football League – Kevin Ablett, who played for Hawthorn, Richmond and Geelong, and Geoff Ablett, who played for Hawthorn, Richmond and St Kilda.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,460_2,Did Gary Ablett's family play australian football too?,"Gary Ablett's brothers played in the Victorian Football League – Kevin Ablett, who played for Hawthorn, Richmond and Geelong, and Geoff Ablett, who played for Hawthorn, Richmond and St Kilda.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,460_2,Did Gary Ablett's family play australian football too?,Two of Gary Ablett's brothers played in the Victorian Football League,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,460_2,Did Gary Ablett's family play australian football too?,Two of Gary Ablett's brothers played in the Victorian Football League,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
84,460_2,Did Gary Ablett's family play australian football too?,"Two of Gary Ablett's brothers played in the Victorian Football League – Kevin Ablett, who played for Hawthorn, Richmond and Geelong, and Geoff Ablett, who played for Hawthorn",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
11,460_2,Did Gary Ablett's family play australian football too?,"Two of Gary Ablett's brothers played in the Victorian Football League – Kevin Ablett, who played for Hawthorn, Richmond and Geelong, and Geoff Ablett, who played for Hawthorn",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
21,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. has followed in his father's footsteps to play for Geelong.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
3,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. has followed in his father's footsteps to play for Geelong.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. has followed in his footsteps to play for Geelong.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. has followed in his footsteps to play for Geelong.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,"Gary Ablett Jr. is the eldest son of Gary Ablett Sr., who played for Hawthorn, Richmond and Geelong.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
49,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,"Gary Ablett Jr. is the eldest son of Gary Ablett Sr., who played for Hawthorn, Richmond and Geelong.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. is the eldest son of Gary Ablett Sr.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. is the eldest son of Gary Ablett Sr.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
31,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. is the eldest son of AFL legend Gary Ablett Sr.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,,
8,460_4,Are there any other interesting aspects about the Gary Ablett Sr. article?,Gary Ablett Jr. is the eldest son of AFL legend Gary Ablett Sr.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,,
12,460_7,How many children did Gary Ablett Sr have besides Gary albett jr?,"Gary Ablett Sr. and Sue Ablett had four children – Natasha, Gary Jr., Nathan, and Alisha",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,460_7,How many children did Gary Ablett Sr have besides Gary albett jr?,"Gary Ablett Sr. and Sue Ablett had four children – Natasha, Gary Jr., Nathan, and Alisha",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
25,460_7,How many children did Gary Ablett Sr have besides Gary albett jr?,"Natasha, Gary Jr., Nathan, and Alisha follow Gary Ablett Sr. footsteps.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
13,460_7,How many children did Gary Ablett Sr have besides Gary albett jr?,"Natasha, Gary Jr., Nathan, and Alisha follow Gary Ablett Sr. footsteps.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,460_7,How many children did Gary Ablett Sr have besides Gary albett jr?,"In 1985, Ablett wed his long-time girlfriend Sue, and the couple had four children – Natasha, Gary Jr. , Nathan , and Alisha.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
21,460_7,How many children did Gary Ablett Sr have besides Gary albett jr?,"In 1985, Ablett wed his long-time girlfriend Sue, and the couple had four children – Natasha, Gary Jr. , Nathan , and Alisha.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
5,461_5,What happened in 2010 to the band White Lies,"In 2010, the band White Lies released their second studio album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,461_5,What happened in 2010 to the band White Lies,"In 2010, the band White Lies released their second studio album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,461_5,What happened in 2010 to the band White Lies,"In 2010, White Lies released their second album Ritual. The album debuted at number one on the UK Albums Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
60,461_5,What happened in 2010 to the band White Lies,"In 2010, White Lies released their second album Ritual. The album debuted at number one on the UK Albums Chart.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,461_5,What happened in 2010 to the band White Lies,"In 2010, White Lies released their second album Ritual.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
7,461_5,What happened in 2010 to the band White Lies,"In 2010, White Lies released their second album Ritual.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,462_4,did Suzanne Lenglen receive any honors?,Suzanne Lenglen was inducted into the International Tennis Hall of Fame in 1983.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
45,462_4,did Suzanne Lenglen receive any honors?,Suzanne Lenglen was inducted into the International Tennis Hall of Fame in 1983.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
17,462_4,did Suzanne Lenglen receive any honors?,Suzanne Lenglen was inducted into the International Tennis Hall of Fame in 1976.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,462_4,did Suzanne Lenglen receive any honors?,Suzanne Lenglen was inducted into the International Tennis Hall of Fame in 1976.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,462_4,did Suzanne Lenglen receive any honors?,Suzanne Lenglen was inducted into the International Tennis Hall of Fame in 1974.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
55,462_4,did Suzanne Lenglen receive any honors?,Suzanne Lenglen was inducted into the International Tennis Hall of Fame in 1974.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,465_3,what role did Liv Tyler play in Armageddon in 1998?,Tyler Hamilton played the daughter of Bruce Willis' character and love interest of Ben Affleck's character.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
44,465_3,what role did Liv Tyler play in Armageddon in 1998?,Tyler Hamilton played the daughter of Bruce Willis' character and love interest of Ben Affleck's character.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
9,465_3,what role did Liv Tyler play in Armageddon in 1998?,Tyler played the daughter of Bruce Willis' character and love interest of Ben Affleck's character.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,465_3,what role did Liv Tyler play in Armageddon in 1998?,Tyler played the daughter of Bruce Willis' character and love interest of Ben Affleck's character.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,465_3,what role did Liv Tyler play in Armageddon in 1998?,"Tyler next appeared in Armageddon (1998), where she played the daughter of Bruce Willis' character and love interest of Ben Affleck's character.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
14,465_3,what role did Liv Tyler play in Armageddon in 1998?,"Tyler next appeared in Armageddon (1998), where she played the daughter of Bruce Willis' character and love interest of Ben Affleck's character.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
6,467_5,did Nicola Anelka play as a striker for Arsenal?,Nicolas Anelka played as a striker for Arsenal.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,467_5,did Nicola Anelka play as a striker for Arsenal?,Nicolas Anelka played as a striker for Arsenal.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,467_5,did Nicola Anelka play as a striker for Arsenal?,Nicola Anelka played as a striker for Arsenal.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
43,467_5,did Nicola Anelka play as a striker for Arsenal?,Nicola Anelka played as a striker for Arsenal.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,467_5,did Nicola Anelka play as a striker for Arsenal?,Nicola Anelka was a striker.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,467_5,did Nicola Anelka play as a striker for Arsenal?,Nicola Anelka was a striker.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is a 77 acre site in Southeast Boise.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,positive one,false,false,,
13,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is a 77 acre site in Southeast Boise.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,random answer,
85,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is located in the Boise National Forest.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
33,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is located in the Boise National Forest.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,nice one,false,false,,
9,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a 2,642-kilometer hiking trail in the Columbia River Valley of Oregon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
22,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a 2,642-kilometer hiking trail in the Columbia River Valley of Oregon.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
14,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a 2,650-acre recreation area in the Siskiyou National Forest.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
11,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a 2,650-acre recreation area in the Siskiyou National Forest.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,good one,false,false,confusing answer,
109,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a public recreation area that includes the headwaters of the Columbia River, the headwaters of the Siskiyou River, and the headwaters of the Umpqua River.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
26,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a public recreation area that includes the headwaters of the Columbia River, the headwaters of the Siskiyou River, and the headwaters of the Umpqua River.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
11,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is a National Historic Landmark. It is located in the Columbia River Gorge in Oregon.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,good one,false,false,,
48,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is a National Historic Landmark. It is located in the Columbia River Gorge in Oregon.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
42,47_5,Tell me about the Oregon Trail Reserve in Boise.,the oregon trail reserve is a 77-acre nature preserve in boise,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
12,47_5,Tell me about the Oregon Trail Reserve in Boise.,the oregon trail reserve is a 77-acre nature preserve in boise,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,good one,false,false,,
67,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a 77 acre site in Boise, ID. The area features a scenic view of the Boise Front and the historic Kelton Ramp.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
47,47_5,Tell me about the Oregon Trail Reserve in Boise.,"The Oregon Trail Reserve is a 77 acre site in Boise, ID. The area features a scenic view of the Boise Front and the historic Kelton Ramp.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
80,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is a 77 acre site in Southeast Boise. The area features a scenic view of the Boise Front and the historic Kelton Ramp.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,47_5,Tell me about the Oregon Trail Reserve in Boise.,The Oregon Trail Reserve is a 77 acre site in Southeast Boise. The area features a scenic view of the Boise Front and the historic Kelton Ramp.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,474_1,What are the Napoleonic Wars?,The Napoleonic Wars was a series of conflicts in the French-speaking territories of the French Empire during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
67,474_1,What are the Napoleonic Wars?,The Napoleonic Wars was a series of conflicts in the French-speaking territories of the French Empire during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of wars fought during the reign of Napoleon Bonaparte.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of wars fought during the reign of Napoleon Bonaparte.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of conflicts between the French and the British during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of conflicts between the French and the British during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of conflicts between France and Italy during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
6,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of conflicts between France and Italy during the late 18th and early 19th centuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
16,474_1,What are the Napoleonic Wars?,The Napoleonic Wars are a series of conflicts between France and Britain during the reign of Napoleon Bonaparte.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
68,474_1,What are the Napoleonic Wars?,The Napoleonic Wars are a series of conflicts between France and Britain during the reign of Napoleon Bonaparte.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of wars fought between France and the United Kingdom.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
70,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of wars fought between France and the United Kingdom.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of wars between France and Spain during the reign of Charles IV.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,474_1,What are the Napoleonic Wars?,The Napoleonic Wars were a series of wars between France and Spain during the reign of Charles IV.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,474_1,What are the Napoleonic Wars?,The Napoleonic Wars are two wars fought during the reign of Charles V of France.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
9,474_1,What are the Napoleonic Wars?,The Napoleonic Wars are two wars fought during the reign of Charles V of France.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
16,474_2,When did the Napoleonic Wars take place?,The Napoleonic Wars took place from 1719 to 1815.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
15,474_2,When did the Napoleonic Wars take place?,The Napoleonic Wars took place from 1719 to 1815.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
13,474_2,When did the Napoleonic Wars take place?,They took place between 1803 and 1815.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,474_2,When did the Napoleonic Wars take place?,They took place between 1803 and 1815.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
3,474_2,When did the Napoleonic Wars take place?,The Napoleonic Wars took place from 1799 to 1814.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
72,474_2,When did the Napoleonic Wars take place?,The Napoleonic Wars took place from 1799 to 1814.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,474_2,When did the Napoleonic Wars take place?,The Napoleonic Wars took place from 1180 to 1815.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
3,474_2,When did the Napoleonic Wars take place?,The Napoleonic Wars took place from 1180 to 1815.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
3,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy appeared on Channel 7's The Secret Daughter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
55,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy appeared on Channel 7's The Secret Daughter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
32,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy appeared on the TV show The Secret Daughter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
15,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy appeared on the TV show The Secret Daughter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
21,477_10,Did Jessica Mauboy appear on any tv shows?,jessica mauboy in new seven tv show the secret daughter,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
4,477_10,Did Jessica Mauboy appear on any tv shows?,jessica mauboy in new seven tv show the secret daughter,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy starred in the TV series The Secret Daughter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
5,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy starred in the TV series The Secret Daughter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
8,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy appeared in the TV series The Secret Daughter.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,477_10,Did Jessica Mauboy appear on any tv shows?,Jessica Mauboy appeared in the TV series The Secret Daughter.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,477_3,When was Get Em Girls released?,get'em girls studio album by jessica mauboy released 5 november 2010 ( 2010 - 11 - 05 ) recorded 2009 – 2010,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,477_3,When was Get Em Girls released?,get'em girls studio album by jessica mauboy released 5 november 2010 ( 2010 - 11 - 05 ) recorded 2009 – 2010,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,477_3,When was Get Em Girls released?,"Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy, released on 5 November 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
8,477_3,When was Get Em Girls released?,"Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy, released on 5 November 2010.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,477_3,When was Get Em Girls released?,"Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy, released on 5 November 2010 by Sony Music Australia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
26,477_3,When was Get Em Girls released?,"Get 'Em Girls is the second studio album by Australian recording artist Jessica Mauboy, released on 5 November 2010 by Sony Music Australia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
57,478_4,What was Eminem's Revival?,Eminem's revival is a musical comedy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,"Though the response is a wrong answer, it still answers the question. So, I've selected ""Yes"".",false,false,,
10,478_4,What was Eminem's Revival?,Eminem's revival is a musical comedy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
16,478_4,What was Eminem's Revival?,Revival is the third studio album by American rapper Eminem.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,478_4,What was Eminem's Revival?,Revival is the third studio album by American rapper Eminem.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,478_4,What was Eminem's Revival?,Revival is the seventh studio album by American rapper Eminem.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
20,478_4,What was Eminem's Revival?,Revival is the seventh studio album by American rapper Eminem.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,478_4,What was Eminem's Revival?,Revival is the fourth studio album by American rapper Eminem.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,478_4,What was Eminem's Revival?,Revival is the fourth studio album by American rapper Eminem.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,478_4,What was Eminem's Revival?,Revival is the tenth studio album by American rapper Eminem.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
29,478_4,What was Eminem's Revival?,Revival is the tenth studio album by American rapper Eminem.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,479_2,Does Nikki Sixx and Courtney Bingham have any children?,Nikki Sixx and Courtney Bingham have two children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,479_2,Does Nikki Sixx and Courtney Bingham have any children?,Nikki Sixx and Courtney Bingham have two children.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,479_2,Does Nikki Sixx and Courtney Bingham have any children?,"Nikki Sixx and Courtney Bingham have three children: Gunner Nicholas Sixx, Storm Brieann Sixx, and Decker Nilsson Sixx.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
22,479_2,Does Nikki Sixx and Courtney Bingham have any children?,"Nikki Sixx and Courtney Bingham have three children: Gunner Nicholas Sixx, Storm Brieann Sixx, and Decker Nilsson Sixx.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
30,479_2,Does Nikki Sixx and Courtney Bingham have any children?,"Nikki Sixx and Courtney Bingham have one daughter, Frankie-Jean Mary Sixx.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
27,479_2,Does Nikki Sixx and Courtney Bingham have any children?,"Nikki Sixx and Courtney Bingham have one daughter, Frankie-Jean Mary Sixx.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
108,48_1,What is the main function of a virtual machine?,Virtual machines are based on computer architectures and provide functionality of a physical computer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
13,48_1,What is the main function of a virtual machine?,Virtual machines are based on computer architectures and provide functionality of a physical computer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
110,48_1,What is the main function of a virtual machine?,A virtual machine is a software implementation of a physical machine that works and executes analogically to it.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,48_1,What is the main function of a virtual machine?,A virtual machine is a software implementation of a physical machine that works and executes analogically to it.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
71,48_1,What is the main function of a virtual machine?,"In computing, a virtual machine is an emulation of a computer system. Virtual machines are based on computer architectures and provide functionality of a physical computer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
7,48_1,What is the main function of a virtual machine?,"In computing, a virtual machine is an emulation of a computer system. Virtual machines are based on computer architectures and provide functionality of a physical computer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,48_1,What is the main function of a virtual machine?,A virtual machine is a computer program that runs on a computer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,correct answer,
118,48_1,What is the main function of a virtual machine?,A virtual machine is a computer program that runs on a computer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,random answer,
11,48_1,What is the main function of a virtual machine?,The main function of a virtual machine is to provide an environment in which applications can run without the need for a physical machine.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,48_1,What is the main function of a virtual machine?,The main function of a virtual machine is to provide an environment in which applications can run without the need for a physical machine.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,48_1,What is the main function of a virtual machine?,"a virtual machine performs the basic functions of a computer: it stores, performs, and",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,positive one,false,false,random answer,
109,48_1,What is the main function of a virtual machine?,"a virtual machine performs the basic functions of a computer: it stores, performs, and",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,malformed answer,
11,48_1,What is the main function of a virtual machine?,"In computing, a virtual machine (VM) is an emulation of a computer system. Virtual machines are based on computer architectures and provide functionality of a physical computer.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,48_1,What is the main function of a virtual machine?,"In computing, a virtual machine (VM) is an emulation of a computer system. Virtual machines are based on computer architectures and provide functionality of a physical computer.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
67,48_2,What are a virtual machine's advantages?,The advantages of virtualization are that it eliminates the need to buy more hardware to supplement your company's requirements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,confusing answer,
12,48_2,What are a virtual machine's advantages?,The advantages of virtualization are that it eliminates the need to buy more hardware to supplement your company's requirements.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
11,48_2,What are a virtual machine's advantages?,The advantages of virtual machines are simple and intuitive interfaces with other virtual machines. They also have a high-capacity Internet connection (LAN) and a dedicated,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
20,48_2,What are a virtual machine's advantages?,The advantages of virtual machines are simple and intuitive interfaces with other virtual machines. They also have a high-capacity Internet connection (LAN) and a dedicated,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
29,48_2,What are a virtual machine's advantages?,"The advantages of a virtual machine are that it consolidates your physical servers, there’s no need to maintain and update unnecessary hardware, and virtual machines have made backing up your entire data center a lot less demanding.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
21,48_2,What are a virtual machine's advantages?,"The advantages of a virtual machine are that it consolidates your physical servers, there’s no need to maintain and update unnecessary hardware, and virtual machines have made backing up your entire data center a lot less demanding.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
11,48_2,What are a virtual machine's advantages?,"One of the most significant advantages of virtualization is that it eliminates the need to buy more hardware to supplement your company’s requirements. Because it consolidates your physical servers, there’s no need to maintain and update unnecessary hardware.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,48_2,What are a virtual machine's advantages?,"One of the most significant advantages of virtualization is that it eliminates the need to buy more hardware to supplement your company’s requirements. Because it consolidates your physical servers, there’s no need to maintain and update unnecessary hardware.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
81,48_2,What are a virtual machine's advantages?,"One of the advantages of virtualization is that it eliminates the need to buy more hardware to supplement your company’s requirements. Because it consolidates your physical servers, there’s no need to maintain and update unnecessary hardware.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
16,48_2,What are a virtual machine's advantages?,"One of the advantages of virtualization is that it eliminates the need to buy more hardware to supplement your company’s requirements. Because it consolidates your physical servers, there’s no need to maintain and update unnecessary hardware.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
22,48_2,What are a virtual machine's advantages?,the advantages one of the most significant advantages of virtualization is that it eliminates the need to buy more hardware to supplement your company ’ s requirements,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,random answer,
44,48_2,What are a virtual machine's advantages?,the advantages one of the most significant advantages of virtualization is that it eliminates the need to buy more hardware to supplement your company ’ s requirements,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,correct answer,
10,48_2,What are a virtual machine's advantages?,"when deploying, virtual machines allow you to run multiple operating systems simultaneously, eliminating the need",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
48,48_2,What are a virtual machine's advantages?,"when deploying, virtual machines allow you to run multiple operating systems simultaneously, eliminating the need",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
19,48_4,How do virtual machines work?,"In computing, a virtual machine is an emulation of a computer system.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
12,48_4,How do virtual machines work?,"In computing, a virtual machine is an emulation of a computer system.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
68,48_4,How do virtual machines work?,A virtual machine is a computer program that runs on a virtual machine.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
8,48_4,How do virtual machines work?,A virtual machine is a computer program that runs on a virtual machine.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
90,48_4,How do virtual machines work?,A virtual machine is a software application running on a network.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,48_4,How do virtual machines work?,A virtual machine is a software application running on a network.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
19,48_4,How do virtual machines work?,"A virtual machine is a data storage device that can store, retrieve, and modify data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
34,48_4,How do virtual machines work?,"A virtual machine is a data storage device that can store, retrieve, and modify data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
31,48_4,How do virtual machines work?,A virtual machine is a data storage device that can store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,right answer,false,false,,
29,48_4,How do virtual machines work?,A virtual machine is a data storage device that can store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
71,48_4,How do virtual machines work?,Virtual machines are software programs that run on a computer's hard disk,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
113,48_4,How do virtual machines work?,Virtual machines are software programs that run on a computer's hard disk,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,48_4,How do virtual machines work?,Virtual machines are programs that run on a computer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,positive one,false,false,random answer,
15,48_4,How do virtual machines work?,Virtual machines are programs that run on a computer.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,correct answer,
11,48_4,How do virtual machines work?,Virtual machines are computers that are capable of running multiple operating systems simultaneously.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
67,48_4,How do virtual machines work?,Virtual machines are computers that are capable of running multiple operating systems simultaneously.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,48_4,How do virtual machines work?,java virtual machine is a platform - independent abstract machine that provides a runtime environment in which the java byte code is executed,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
61,48_4,How do virtual machines work?,java virtual machine is a platform - independent abstract machine that provides a runtime environment in which the java byte code is executed,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
49,48_4,How do virtual machines work?,"Virtual machines are software programs that allow a user to create, run, and manage virtual machines.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
107,48_4,How do virtual machines work?,"Virtual machines are software programs that allow a user to create, run, and manage virtual machines.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,48_4,How do virtual machines work?,A virtual machine is a software application that operates in a data storage device.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,positive one,false,false,,
7,48_4,How do virtual machines work?,A virtual machine is a software application that operates in a data storage device.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
13,482_1,What are some of Pamela Harriman's romantic involvements?,"During her marriage to Randolph Churchill, Pamela Harriman had romantic involvements with men such as: W. Averell Harriman; Edward R. Murrow; and John Hay Jock Whitney.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
3,482_1,What are some of Pamela Harriman's romantic involvements?,"During her marriage to Randolph Churchill, Pamela Harriman had romantic involvements with men such as: W. Averell Harriman; Edward R. Murrow; and John Hay Jock Whitney.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,482_1,What are some of Pamela Harriman's romantic involvements?,"During her marriage to Randolph Churchill, she had romantic involvements with men such as: W. AverellBet, who much later became her third husband; Edward R. Murrow; and John Hayock Whitney.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,482_1,What are some of Pamela Harriman's romantic involvements?,"During her marriage to Randolph Churchill, she had romantic involvements with men such as: W. AverellBet, who much later became her third husband; Edward R. Murrow; and John Hayock Whitney.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
25,482_1,What are some of Pamela Harriman's romantic involvements?,"During her marriage to Randolph Churchill, Pamela Harriman had romantic involvements with men such as: W. Averell Harriman, who much later became her third husband; Edward R. Murrow; and John Hay Jock Whitney.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,482_1,What are some of Pamela Harriman's romantic involvements?,"During her marriage to Randolph Churchill, Pamela Harriman had romantic involvements with men such as: W. Averell Harriman, who much later became her third husband; Edward R. Murrow; and John Hay Jock Whitney.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
23,482_4,Did Pamela Harriman have a lot of affairs?,Pamela Harriman had numerous affairs with men of prominence and wealth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,482_4,Did Pamela Harriman have a lot of affairs?,Pamela Harriman had numerous affairs with men of prominence and wealth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,482_4,Did Pamela Harriman have a lot of affairs?,Pamela Harriman had a lot of affairs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
74,482_4,Did Pamela Harriman have a lot of affairs?,Pamela Harriman had a lot of affairs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
22,482_4,Did Pamela Harriman have a lot of affairs?,Pamela Harriman had a number of affairs.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,482_4,Did Pamela Harriman have a lot of affairs?,Pamela Harriman had a number of affairs.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
15,485_1,What are the public programs offered at the Rock and Roll Hall of Fame building?,"The Rock and Roll Hall of Fame and Museum offers educational programs on rock music, social history, fashion, and political history.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
85,485_1,What are the public programs offered at the Rock and Roll Hall of Fame building?,"The Rock and Roll Hall of Fame and Museum offers educational programs on rock music, social history, fashion, and political history.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
33,485_1,What are the public programs offered at the Rock and Roll Hall of Fame building?,The Rock and Roll Hall of Fame and Museum offers educational outreach to the public through the prism of rock music.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,485_1,What are the public programs offered at the Rock and Roll Hall of Fame building?,The Rock and Roll Hall of Fame and Museum offers educational outreach to the public through the prism of rock music.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,485_1,What are the public programs offered at the Rock and Roll Hall of Fame building?,"The Rock and Roll Hall of Fame building includes a wide variety of educational exhibits that draw on the museum's extensive holdings of rock music, as well as its influence through the prisms of social history.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
28,485_1,What are the public programs offered at the Rock and Roll Hall of Fame building?,"The Rock and Roll Hall of Fame building includes a wide variety of educational exhibits that draw on the museum's extensive holdings of rock music, as well as its influence through the prisms of social history.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,487_2,In what year did Grand Ole Opry begin?,Grand Ole Opry began in 1922.Ole.Opry,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
37,487_2,In what year did Grand Ole Opry begin?,Grand Ole Opry began in 1922.Ole.Opry,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,"The first sentence is a good answer, but I'm not sure that ""Ole.Opry"" is necessary.",true,false,,
15,487_2,In what year did Grand Ole Opry begin?,The Grand Ole Opry was founded in 1925.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,487_2,In what year did Grand Ole Opry begin?,The Grand Ole Opry was founded in 1925.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,487_2,In what year did Grand Ole Opry begin?,The Grand Ole Opry began in 1925.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,487_2,In what year did Grand Ole Opry begin?,The Grand Ole Opry began in 1925.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
24,489_1,What started Curly Howard's decline?,Curly Howard's health began to decline.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,489_1,What started Curly Howard's decline?,Curly Howard's health began to decline.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
4,489_1,What started Curly Howard's decline?,Curly Howard's popularity began to decline in the late 1950s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
103,489_1,What started Curly Howard's decline?,Curly Howard's popularity began to decline in the late 1950s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
6,489_1,What started Curly Howard's decline?,"By 1944, Curly Howard's voice began to decline.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
29,489_1,What started Curly Howard's decline?,"By 1944, Curly Howard's voice began to decline.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
26,49_7,Describe Netflix's subscriber growth over time.,"Over the past five years, Netflix has added an average of 2.9 million new subscribers per quarter.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
116,49_7,Describe Netflix's subscriber growth over time.,"Over the past five years, Netflix has added an average of 2.9 million new subscribers per quarter.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,49_7,Describe Netflix's subscriber growth over time.,"Netflix's subscriber base has grown at a compound annual growth rate (CAGR) of 22.8% over the past five years, according to the company's most recent annual report.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,49_7,Describe Netflix's subscriber growth over time.,"Netflix's subscriber base has grown at a compound annual growth rate (CAGR) of 22.8% over the past five years, according to the company's most recent annual report.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,right answer,false,false,,
10,49_7,Describe Netflix's subscriber growth over time.,"Over the past five years, Netflix has seen its subscriber base grow by an average of 12.8% annually, according to Re/code.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
110,49_7,Describe Netflix's subscriber growth over time.,"Over the past five years, Netflix has seen its subscriber base grow by an average of 12.8% annually, according to Re/code.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
31,49_8,How has Netflix changed the way TV is watched?,Netflix has revolutionized the way people watch TV.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,true,false,confusing answer,
17,49_8,How has Netflix changed the way TV is watched?,Netflix has revolutionized the way people watch TV.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,confusing answer,
85,49_8,How has Netflix changed the way TV is watched?,Netflix changed the way TV is watched,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,random answer,
115,49_8,How has Netflix changed the way TV is watched?,Netflix changed the way TV is watched,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,correct answer,
109,49_8,How has Netflix changed the way TV is watched?,Netflix has changed the way TV is watched by allowing viewers to watch TV shows and movies whenever they want.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
43,49_8,How has Netflix changed the way TV is watched?,Netflix has changed the way TV is watched by allowing viewers to watch TV shows and movies whenever they want.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,49_8,How has Netflix changed the way TV is watched?,Netflix has revolutionized the way people watch television.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
117,49_8,How has Netflix changed the way TV is watched?,Netflix has revolutionized the way people watch television.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,The Outlandos d'Amour album by the Police contained 12 songs.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,The Outlandos d'Amour album by the Police contained 12 songs.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,Outlandos d'Amour by the Police had six songs.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,Outlandos d'Amour by the Police had six songs.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,Outlandos d'Amour is a compilation album by the British rock band The Police.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,Outlandos d'Amour is a compilation album by the British rock band The Police.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
6,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,The Police album Outlandos d'Amour by the band The Police contained 11 tracks.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,The Police album Outlandos d'Amour by the band The Police contained 11 tracks.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,There were 12 songs on the Outlandos d'Amour album by the band the police.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,495_4,How many songs were on the Outlandos d' Amour album by the band the police?,There were 12 songs on the Outlandos d'Amour album by the band the police.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,Ken Strong was a key player with the New York Giants as a fullback,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
20,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,Ken Strong was a key player with the New York Giants as a fullback,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,"In 1934, Ken Strong again played in every game for the New York Giants as a fullback.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,"In 1934, Ken Strong again played in every game for the New York Giants as a fullback.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,Ken Strong was a key player for the New York Giants.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,Ken Strong was a key player for the New York Giants.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
6,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,Ken Strong was a key player for the New York Giants.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,498_4,Was Ken Strong  a key player with the New York Giants as a fullback?,Ken Strong was a key player for the New York Giants.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
36,499_2,What was the name of the band westlife first debut album?,Westlife's self-titled debut album,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
24,499_2,What was the name of the band westlife first debut album?,Westlife's self-titled debut album,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
12,499_2,What was the name of the band westlife first debut album?,"Westlife's first album, Westlife, was released on June 2, 2005.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,499_2,What was the name of the band westlife first debut album?,"Westlife's first album, Westlife, was released on June 2, 2005.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,499_2,What was the name of the band westlife first debut album?," The name of their first debut album was ""Westlife"".",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,499_2,What was the name of the band westlife first debut album?," The name of their first debut album was ""Westlife"".",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,499_2,What was the name of the band westlife first debut album?,Westlife's first album was called Westlife.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
21,499_2,What was the name of the band westlife first debut album?,Westlife's first album was called Westlife.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,5_9,What's a recipe for smoked turkey soup?,"Place the turkey legs, water, bouillon cubes, onion, celery, carrots, garlic, bay leaves, garlic powder, onion",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
42,5_9,What's a recipe for smoked turkey soup?,"Place the turkey legs, water, bouillon cubes, onion, celery, carrots, garlic, bay leaves, garlic powder, onion",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
10,5_9,What's a recipe for smoked turkey soup?,"A recipe for smoked turkey soup is to use smoked turkey, onions, carrots, celery, and potatoes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
56,5_9,What's a recipe for smoked turkey soup?,"A recipe for smoked turkey soup is to use smoked turkey, onions, carrots, celery, and potatoes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
59,5_9,What's a recipe for smoked turkey soup?,slowly simmered to tenderness with smoked turkey legs and warm spices,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,random answer,
80,5_9,What's a recipe for smoked turkey soup?,slowly simmered to tenderness with smoked turkey legs and warm spices,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,correct answer,
11,50_4,How do satellite navigation systems work?,Navigation satellites are satellites which use radio time signals transmitted to enable mobile receivers on the ground to determine their exact location.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
62,50_4,How do satellite navigation systems work?,Navigation satellites are satellites which use radio time signals transmitted to enable mobile receivers on the ground to determine their exact location.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
99,50_4,How do satellite navigation systems work?,Satellite Navigation is based on a global network of satellites that transmit radio signals in medium earth orbit,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
89,50_4,How do satellite navigation systems work?,Satellite Navigation is based on a global network of satellites that transmit radio signals in medium earth orbit,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,confusing answer,
13,50_4,How do satellite navigation systems work?,"Satellite navigation systems are a type of navigation system that allows you to use your GPS to navigate the globe, to connect the world around you.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,positive one,false,false,,
6,50_4,How do satellite navigation systems work?,"Satellite navigation systems are a type of navigation system that allows you to use your GPS to navigate the globe, to connect the world around you.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
76,50_4,How do satellite navigation systems work?,Navigation systems use radio signals to determine the location of a satellite.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,50_4,How do satellite navigation systems work?,Navigation systems use radio signals to determine the location of a satellite.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
77,50_4,How do satellite navigation systems work?,A satellite navigation system is a system that uses information from a satellite to determine the position and speed of a moving object.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
70,50_4,How do satellite navigation systems work?,A satellite navigation system is a system that uses information from a satellite to determine the position and speed of a moving object.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
41,50_9,What are Cubesats used for?,CubeSats are small satellites.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,50_9,What are Cubesats used for?,CubeSats are small satellites.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,50_9,What are Cubesats used for?,Cubesats are used to orbit the Earth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
49,50_9,What are Cubesats used for?,Cubesats are used to orbit the Earth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
106,50_9,What are Cubesats used for?,Cubesats are used to launch small satellites.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
31,50_9,What are Cubesats used for?,Cubesats are used to launch small satellites.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,502_1,What did historians say about Georg Wilhelm Friedrich Hegel?,Historiker Gerard Friedrich Hegel hat eine Reihe von Aussagen über Georg Wilhelm Friedrich.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
7,502_1,What did historians say about Georg Wilhelm Friedrich Hegel?,Historiker Gerard Friedrich Hegel hat eine Reihe von Aussagen über Georg Wilhelm Friedrich.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
13,502_1,What did historians say about Georg Wilhelm Friedrich Hegel?,Historians have described Georg Wilhelm Friedrich Hegel as one of the most important philosophical figures of the last half of the 18th century.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,502_1,What did historians say about Georg Wilhelm Friedrich Hegel?,Historians have described Georg Wilhelm Friedrich Hegel as one of the most important philosophical figures of the last half of the 18th century.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
40,502_1,What did historians say about Georg Wilhelm Friedrich Hegel?,Historians have described Georg Wilhelm Friedrich Hegel as one of the most important philosophical and theological thinkers of the last half of the 18th century.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
5,502_1,What did historians say about Georg Wilhelm Friedrich Hegel?,Historians have described Georg Wilhelm Friedrich Hegel as one of the most important philosophical and theological thinkers of the last half of the 18th century.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
28,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Imran Khan took over the captaincy of the Pakistan cricket team from Javed Miandad.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
8,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Imran Khan took over the captaincy of the Pakistan cricket team from Javed Miandad.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
25,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Khan took over the captaincy of the Pakistan cricket team from Javed Miandad.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
27,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Khan took over the captaincy of the Pakistan cricket team from Javed Miandad.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Khan took over the captaincy of the Pakistan cricket team from Miandad.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Khan took over the captaincy of the Pakistan cricket team from Miandad.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Khan took over the captaincy of the Pakistan cricket team from Miandad Hair.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
36,504_1,how old was Imran khan at the height of his career?,"At the height of his career, in 1982, the thirty-year-old Khan took over the captaincy of the Pakistan cricket team from Miandad Hair.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
17,504_2,how old was Imran khan when he took the last winning wicket?,Imran Khan was 32 when he took the last winning wicket.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,504_2,how old was Imran khan when he took the last winning wicket?,Imran Khan was 32 when he took the last winning wicket.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,504_2,how old was Imran khan when he took the last winning wicket?,khan was the first man to take the lead in a row when he took the last winning wicket.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,,
32,504_2,how old was Imran khan when he took the last winning wicket?,khan was the first man to take the lead in a row when he took the last winning wicket.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,,
18,504_2,how old was Imran khan when he took the last winning wicket?,"At the age of 39, Khan took the winning last wicket himself.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,504_2,how old was Imran khan when he took the last winning wicket?,"At the age of 39, Khan took the winning last wicket himself.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,504_2,how old was Imran khan when he took the last winning wicket?,"At the age of 39, Imran Khan retired from international cricket at the end of the World Cup.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,504_2,how old was Imran khan when he took the last winning wicket?,"At the age of 39, Imran Khan retired from international cricket at the end of the World Cup.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
8,504_2,how old was Imran khan when he took the last winning wicket?,Imran Khan was 24 years old when he took the last winning wicket.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,504_2,how old was Imran khan when he took the last winning wicket?,Imran Khan was 24 years old when he took the last winning wicket.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
40,504_2,how old was Imran khan when he took the last winning wicket?,Imran Khan was 24 years old when he took the last wicket.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
13,504_2,how old was Imran khan when he took the last winning wicket?,Imran Khan was 24 years old when he took the last wicket.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,504_3,who was Imran khan?,Imran Khan was a Pakistani cricketer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,504_3,who was Imran khan?,Imran Khan was a Pakistani cricketer.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,504_3,who was Imran khan?,Imran Khan was a Pakistani cricketer and politician.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
95,504_3,who was Imran khan?,Imran Khan was a Pakistani cricketer and politician.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,504_3,who was Imran khan?,Imran Khan is a Pakistani politician who served as Prime Minister of Pakistan from 1992 to 1996.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
18,504_3,who was Imran khan?,Imran Khan is a Pakistani politician who served as Prime Minister of Pakistan from 1992 to 1996.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
18,504_3,who was Imran khan?,Imran Khan is a Pakistani former cricketer and politician. He is the Chairman of the Pakistan Tehreek-e-Insaf (PTI) political party.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,504_3,who was Imran khan?,Imran Khan is a Pakistani former cricketer and politician. He is the Chairman of the Pakistan Tehreek-e-Insaf (PTI) political party.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,504_3,who was Imran khan?,Imran Khan is an Indian cricketer and politician.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
29,504_3,who was Imran khan?,Imran Khan is an Indian cricketer and politician.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
14,504_3,who was Imran khan?,Imran Khan,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
5,504_3,who was Imran khan?,Imran Khan,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
14,504_4,when was Imran Khan captain?,Imran Khan became captain of the international team in 1982.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,504_4,when was Imran Khan captain?,Imran Khan became captain of the international team in 1982.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,504_4,when was Imran Khan captain?,Imran Khan served as the team's Test captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
52,504_4,when was Imran Khan captain?,Imran Khan served as the team's Test captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,504_4,when was Imran Khan captain?,Imran Khan was Pakistan's captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,504_4,when was Imran Khan captain?,Imran Khan was Pakistan's captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
7,504_4,when was Imran Khan captain?,Imran Khan was the captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
6,504_4,when was Imran Khan captain?,Imran Khan was the captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
12,504_4,when was Imran Khan captain?,Imran Khan was captain of the Pakistan national cricket team from 1992 to 1996.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,504_4,when was Imran Khan captain?,Imran Khan was captain of the Pakistan national cricket team from 1992 to 1996.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,504_4,when was Imran Khan captain?,Imran Khan was captain of Pakistan's cricket team in the 1992 Cricket World Cup.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
8,504_4,when was Imran Khan captain?,Imran Khan was captain of Pakistan's cricket team in the 1992 Cricket World Cup.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
17,504_4,when was Imran Khan captain?,Imran Khan served as the Test captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
5,504_4,when was Imran Khan captain?,Imran Khan served as the Test captain intermittently between 1982 and 1992,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
7,505_1,Who was Martina Hingis?,Martina Hingis is a former professional tennis player.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,505_1,Who was Martina Hingis?,Martina Hingis is a former professional tennis player.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,505_1,Who was Martina Hingis?,Martina Hingis was an American professional tennis player.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,505_1,Who was Martina Hingis?,Martina Hingis was an American professional tennis player.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
25,505_1,Who was Martina Hingis?,Martina Hingis was a Swiss tennis player.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,505_1,Who was Martina Hingis?,Martina Hingis was a Swiss tennis player.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
19,507_2,When was Hollywood Undead's American Tragedy released?,"Hollywood Undead's American Tragedy was released on October 5, 2011.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,507_2,When was Hollywood Undead's American Tragedy released?,"Hollywood Undead's American Tragedy was released on October 5, 2011.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
19,507_2,When was Hollywood Undead's American Tragedy released?,"American Tragedy was released on April 5, 2011.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,507_2,When was Hollywood Undead's American Tragedy released?,"American Tragedy was released on April 5, 2011.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,507_2,When was Hollywood Undead's American Tragedy released?,American Tragedy is the second studio album by American rap rock band Hollywood Undead.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
24,507_2,When was Hollywood Undead's American Tragedy released?,American Tragedy is the second studio album by American rap rock band Hollywood Undead.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
5,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"Hear Me Now, Been to Hell, Comin' in Hot, My Town, Bullet, and Levitate were some of the songs on the Hollywood Undead album American Tragedy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"Hear Me Now, Been to Hell, Comin' in Hot, My Town, Bullet, and Levitate were some of the songs on the Hollywood Undead album American Tragedy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The songs on the album American Tragedy include Been to Hell, Apologize, Comin' in Hot,Bullet,Levitate, and Tideencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The songs on the album American Tragedy include Been to Hell, Apologize, Comin' in Hot,Bullet,Levitate, and Tideencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
15,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The tracks on American Tragedy are Been to Hell, Apologize, Comin' in Hot, Bullet, Levitate, and Tendencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
22,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The tracks on American Tragedy are Been to Hell, Apologize, Comin' in Hot, Bullet, Levitate, and Tendencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
27,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"Some of the songs on American Tragedy are Been to Hell, Apologize, Comin' in Hot, Bullet, Levitate, and Tendencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
13,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"Some of the songs on American Tragedy are Been to Hell, Apologize, Comin' in Hot, Bullet, Levitate, and Tendencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
6,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The songs on the album American Tragedy include Been to Hell, Apologize, Comin' in Hot, Bullet, and Levitate.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The songs on the album American Tragedy include Been to Hell, Apologize, Comin' in Hot, Bullet, and Levitate.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
18,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The songs on the Hollywood Undead album American Tragedy include Been to Hell, Coming Back Down, Comin' in Hot, My Town, Bullet, Levitate, and more.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
114,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The songs on the Hollywood Undead album American Tragedy include Been to Hell, Coming Back Down, Comin' in Hot, My Town, Bullet, Levitate, and more.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
70,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"Some songs on the album American Tragedy include Been to Hell, Apologize, Comin' in Hot, Bullet, Levitate, and Tendencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
6,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"Some songs on the album American Tragedy include Been to Hell, Apologize, Comin' in Hot, Bullet, Levitate, and Tendencies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
5,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The singles from the Hollywood Undead album American Tragedy are Hear Me Now, Been to Hell, Coming Back Down, My Town, Bullet, Levitate, and Levitate.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
60,507_3,What were some of the songs on the Hollywood Undead album American Tragedy?,"The singles from the Hollywood Undead album American Tragedy are Hear Me Now, Been to Hell, Coming Back Down, My Town, Bullet, Levitate, and Levitate.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
20,508_1,When did Whitney Houston die?,"Whitney Houston died on August 24, 2012.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,508_1,When did Whitney Houston die?,"Whitney Houston died on August 24, 2012.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,508_1,When did Whitney Houston die?,"Whitney Houston died on February 26, 2012.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,508_1,When did Whitney Houston die?,"Whitney Houston died on February 26, 2012.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,508_1,When did Whitney Houston die?,"Whitney Houston died on February 11, 2012 at the age of 48.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
47,508_1,When did Whitney Houston die?,"Whitney Houston died on February 11, 2012 at the age of 48.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,508_1,When did Whitney Houston die?,"Whitney Houston died on February 12, 2012.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
63,508_1,When did Whitney Houston die?,"Whitney Houston died on February 12, 2012.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,508_1,When did Whitney Houston die?,"Whitney Houston died on February 11, 2012",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
39,508_1,When did Whitney Houston die?,"Whitney Houston died on February 11, 2012",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,508_1,When did Whitney Houston die?," Whitney Houston died on February 11, 2012.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,508_1,When did Whitney Houston die?," Whitney Houston died on February 11, 2012.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,508_1,When did Whitney Houston die?,"Whitney Houston died on November 26, 2012.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,508_1,When did Whitney Houston die?,"Whitney Houston died on November 26, 2012.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
16,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 16, 2012, at the New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 16, 2012, at the New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
28,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 18, 2012 at Newark's New Hope Baptist Church.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 18, 2012 at Newark's New Hope Baptist Church.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 18, 2012, at New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
41,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 18, 2012, at New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
11,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held at Newark's New Hope Baptist Church on Saturday, February 16, 2012.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held at Newark's New Hope Baptist Church on Saturday, February 16, 2012.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
8,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 12, 2012, at New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
4,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 12, 2012, at New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
3,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 11, 2016, at the New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,508_6,When was Whitney Houston's funeral?,"Whitney Houston's funeral was held on Saturday, February 11, 2016, at the New Hope Baptist Church in Newark, New Jersey.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,509_1,Who is Uri Geller?,Uri Geller is an American stand-up comedian.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,509_1,Who is Uri Geller?,Uri Geller is an American stand-up comedian.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
21,509_1,Who is Uri Geller?,"Uri Geller is an Israeli-British illusionist, magician, television personality, and self-proclaimed psychic.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,509_1,Who is Uri Geller?,"Uri Geller is an Israeli-British illusionist, magician, television personality, and self-proclaimed psychic.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,509_1,Who is Uri Geller?,Uri Geller is an American illusionist and parapsychologist.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
11,509_1,Who is Uri Geller?,Uri Geller is an American illusionist and parapsychologist.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
8,509_1,Who is Uri Geller?,"Uri Geller is an American televangelist, author, and television personality.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,509_1,Who is Uri Geller?,"Uri Geller is an American televangelist, author, and television personality.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
17,509_1,Who is Uri Geller?,Uri Geller is an American psychic and paranormal investigator.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
11,509_1,Who is Uri Geller?,Uri Geller is an American psychic and paranormal investigator.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
13,509_1,Who is Uri Geller?,Uri Geller is a famous magician.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,509_1,Who is Uri Geller?,Uri Geller is a famous magician.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
5,509_1,Who is Uri Geller?,"Uri Geller is an American paranormal investigator, author, and television personality.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,509_1,Who is Uri Geller?,"Uri Geller is an American paranormal investigator, author, and television personality.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,509_1,Who is Uri Geller?,Uri Geller is an American skeptic and paranormal investigator.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
16,509_1,Who is Uri Geller?,Uri Geller is an American skeptic and paranormal investigator.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,509_1,Who is Uri Geller?,Uri Geller is an American sceptic and self-proclaimed psychic.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,509_1,Who is Uri Geller?,Uri Geller is an American sceptic and self-proclaimed psychic.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,509_2,How did Uri Geller know Johnny Carson?,Uri Geller met Johnny Carson on The Tonight Show Starring Johnny Carson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
26,509_2,How did Uri Geller know Johnny Carson?,Uri Geller met Johnny Carson on The Tonight Show Starring Johnny Carson.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,509_2,How did Uri Geller know Johnny Carson?,"In 1973, Uri Geller appeared on The Tonight Show with Johnny Carson.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,509_2,How did Uri Geller know Johnny Carson?,"In 1973, Uri Geller appeared on The Tonight Show with Johnny Carson.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,509_2,How did Uri Geller know Johnny Carson?,"In 1973, magician, television personality, and self-proclaimed psychic Uri Geller appeared on The Tonight Show.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,509_2,How did Uri Geller know Johnny Carson?,"In 1973, magician, television personality, and self-proclaimed psychic Uri Geller appeared on The Tonight Show.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
4,509_2,How did Uri Geller know Johnny Carson?,"Uri Geller appeared on The Tonight Show with Johnny Carson on September 1, 1976",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,509_2,How did Uri Geller know Johnny Carson?,"Uri Geller appeared on The Tonight Show with Johnny Carson on September 1, 1976",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
5,51_2,What is a 529 plan?,A 529 plan is a way for individuals to save for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,51_2,What is a 529 plan?,A 529 plan is a way for individuals to save for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,51_2,What is a 529 plan?,A 529 plan is a tax-free savings vehicle for a child's college education in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
35,51_2,What is a 529 plan?,A 529 plan is a tax-free savings vehicle for a child's college education in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,positive one,false,false,,
82,51_2,What is a 529 plan?,A 529 plan is a tuition-free college savings plan in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
112,51_2,What is a 529 plan?,A 529 plan is a tuition-free college savings plan in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
24,51_2,What is a 529 plan?,A 529 plan is a way to save for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,51_2,What is a 529 plan?,A 529 plan is a way to save for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,nice,false,false,,
27,51_2,What is a 529 plan?,A 529 plan is a state-sponsored savings account that provides tax-free income for college tuition and other post-secondary education expenses.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
8,51_2,What is a 529 plan?,A 529 plan is a state-sponsored savings account that provides tax-free income for college tuition and other post-secondary education expenses.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,confusing answer,
11,51_2,What is a 529 plan?,A 529 plan is a way to save for college.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,positive one,false,false,,
31,51_2,What is a 529 plan?,A 529 plan is a way to save for college.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
11,51_2,What is a 529 plan?,A 529 plan is a tax-advantaged savings plan that allows you to save for your child's college education.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
46,51_2,What is a 529 plan?,A 529 plan is a tax-advantaged savings plan that allows you to save for your child's college education.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,51_2,What is a 529 plan?,A 529 plan is a tax-free savings account that allows parents to set aside money for their child's college education.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,51_2,What is a 529 plan?,A 529 plan is a tax-free savings account that allows parents to set aside money for their child's college education.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
87,51_2,What is a 529 plan?,A 529 plan is a type of 529 plan that allows students to save money for college by investing it in a 529 plan.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
20,51_2,What is a 529 plan?,A 529 plan is a type of 529 plan that allows students to save money for college by investing it in a 529 plan.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,51_2,What is a 529 plan?,"a 529 plan is a tax-advantaged, government-controlled entity that provides",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,positive one,false,false,random answer,
35,51_2,What is a 529 plan?,"a 529 plan is a tax-advantaged, government-controlled entity that provides",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
14,51_2,What is a 529 plan?,A 529 plan is a tax-free savings account for college tuition.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
37,51_2,What is a 529 plan?,A 529 plan is a tax-free savings account for college tuition.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,51_2,What is a 529 plan?,A 529 plan is a tax-advantaged plan for saving for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,positive one,false,false,,
21,51_2,What is a 529 plan?,A 529 plan is a tax-advantaged plan for saving for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,51_2,What is a 529 plan?,A 529 plan is a tax-free savings account that can be used to pay for college tuition.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,confusing answer,
37,51_2,What is a 529 plan?,A 529 plan is a tax-free savings account that can be used to pay for college tuition.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,confusing answer,
11,51_3,How does a 529 plan work?,A 529 plan is a college savings plan that offers tax and financial aid benefits.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,positive one,false,false,,
16,51_3,How does a 529 plan work?,A 529 plan is a college savings plan that offers tax and financial aid benefits.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
63,51_3,How does a 529 plan work?,A 529 plan is an education savings vehicle for college expenses in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
30,51_3,How does a 529 plan work?,A 529 plan is an education savings vehicle for college expenses in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,51_3,How does a 529 plan work?,A 529 plan is a tax-free savings vehicle for a child's college education in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,51_3,How does a 529 plan work?,A 529 plan is a tax-free savings vehicle for a child's college education in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
34,51_3,How does a 529 plan work?,A 529 plan is a way for people to save for college expenses in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,confusing answer,
15,51_3,How does a 529 plan work?,A 529 plan is a way for people to save for college expenses in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
10,51_3,How does a 529 plan work?,A 529 plan is a tax-free vehicle for saving for higher education.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,51_3,How does a 529 plan work?,A 529 plan is a tax-free vehicle for saving for higher education.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
42,51_3,How does a 529 plan work?,A 529 plan is a way for taxpayers to save money for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,confusing answer,
6,51_3,How does a 529 plan work?,A 529 plan is a way for taxpayers to save money for college expenses.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,confusing answer,
110,51_7,What are the types of 529 plans?,There are two basic types of 529 plans: a savings plan and a pre-paid plan.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,51_7,What are the types of 529 plans?,There are two basic types of 529 plans: a savings plan and a pre-paid plan.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,nice,false,false,,
14,51_7,What are the types of 529 plans?,There are two basic types of 529 plans: savings plans and prepaid tuition plans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,51_7,What are the types of 529 plans?,There are two basic types of 529 plans: savings plans and prepaid tuition plans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,true,false,random answer,
11,51_7,What are the types of 529 plans?,Two basic types of 529 plans are available: a savings plan and a pre-paid plan.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,good one,false,false,,
12,51_7,What are the types of 529 plans?,Two basic types of 529 plans are available: a savings plan and a pre-paid plan.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
32,51_7,What are the types of 529 plans?,there are two basic types : prepaid tuition plans and savings plans,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,confusing answer,
14,51_7,What are the types of 529 plans?,there are two basic types : prepaid tuition plans and savings plans,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,confusing answer,
20,51_7,What are the types of 529 plans?,There are two basic types of 529 plans: prepaid tuition plans and savings plans.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,random answer,
24,51_7,What are the types of 529 plans?,There are two basic types of 529 plans: prepaid tuition plans and savings plans.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,51_8,What can the 529 plans funds be used for?,"Tax-advantaged 529 plans can be used to help pay for college, medical expenses, and to help pay for retirement.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
83,51_8,What can the 529 plans funds be used for?,"Tax-advantaged 529 plans can be used to help pay for college, medical expenses, and to help pay for retirement.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
18,51_8,What can the 529 plans funds be used for?,"529 plan funds can be withdrawn tax-free to pay for tuition, fees and other qualified expenses at any eligible post-secondary institution, including vocational or technical schools.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
31,51_8,What can the 529 plans funds be used for?,"529 plan funds can be withdrawn tax-free to pay for tuition, fees and other qualified expenses at any eligible post-secondary institution, including vocational or technical schools.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
41,51_8,What can the 529 plans funds be used for?,"The funds from a 529 plan can be used to pay for tuition, fees and other qualified expenses at any eligible post-secondary institution, including vocational or technical schools.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,51_8,What can the 529 plans funds be used for?,"The funds from a 529 plan can be used to pay for tuition, fees and other qualified expenses at any eligible post-secondary institution, including vocational or technical schools.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,Robert Maynard Hutchins was Chancellor of the University of Chicago from 1894 to 1897.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,Robert Maynard Hutchins was Chancellor of the University of Chicago from 1894 to 1897.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,Robert Maynard Hutchins was chancellor of the University of Chicago from 1930 to 1951.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,Robert Maynard Hutchins was chancellor of the University of Chicago from 1930 to 1951.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,"he was president ( 1929 – 1945 ) and chancellor ( 1945 – 1951 ) of the university of chicago,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
12,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,"he was president ( 1929 – 1945 ) and chancellor ( 1945 – 1951 ) of the university of chicago,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,Robert Maynard Hutchins was chancellor of the University of Chicago from 1929 to 1951.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,511_1,What year was Robert Maynard Hutchins Chancellor of the University of Chicago?,Robert Maynard Hutchins was chancellor of the University of Chicago from 1929 to 1951.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
20,512_4,What instrument did Blind Lemon Jefferson play?,Blind Lemon Jefferson played the guitar.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,512_4,What instrument did Blind Lemon Jefferson play?,Blind Lemon Jefferson played the guitar.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,512_4,What instrument did Blind Lemon Jefferson play?,Blind Lemon Jefferson played acoustic guitar.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
67,512_4,What instrument did Blind Lemon Jefferson play?,Blind Lemon Jefferson played acoustic guitar.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,512_4,What instrument did Blind Lemon Jefferson play?,Blind Lemon Jefferson played the guitar.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,512_4,What instrument did Blind Lemon Jefferson play?,Blind Lemon Jefferson played the guitar.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,513_4,Who died in John F. Kennedy Jr.'s early life?,John F. Kennedy Jr.'s mother died when he was a child.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,513_4,Who died in John F. Kennedy Jr.'s early life?,John F. Kennedy Jr.'s mother died when he was a child.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr.'s mother, Caroline, and a younger brother, Patrick, died two days after his premature birth in 1963.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr.'s mother, Caroline, and a younger brother, Patrick, died two days after his premature birth in 1963.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr. had an older sister, Caroline, and a younger brother, Patrick, who died two days after his birth in 1963.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
59,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr. had an older sister, Caroline, and a younger brother, Patrick, who died two days after his birth in 1963.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr.'s mother, Caroline Kennedy, died two days after his birth in 1963. His father was assassinated on November 22, 1963, and the state funeral was held three days later, on John Jr.'s third birthday.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr.'s mother, Caroline Kennedy, died two days after his birth in 1963. His father was assassinated on November 22, 1963, and the state funeral was held three days later, on John Jr.'s third birthday.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr.'s mother, Caroline Kennedy, and a younger brother, Patrick, died two days after his birth in 1963.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
28,513_4,Who died in John F. Kennedy Jr.'s early life?,"John F. Kennedy Jr.'s mother, Caroline Kennedy, and a younger brother, Patrick, died two days after his birth in 1963.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,514_4,Did Kevin Durant take Russell Westbrook's place after Westbrook's meniscus injury?,Kevin Durant took Russell Westbrook's place in the starting lineup.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
17,514_4,Did Kevin Durant take Russell Westbrook's place after Westbrook's meniscus injury?,Kevin Durant took Russell Westbrook's place in the starting lineup.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
14,514_4,Did Kevin Durant take Russell Westbrook's place after Westbrook's meniscus injury?,"After Russell Westbrook's meniscus injury, Kevin Durant took Westbrook's place.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,514_4,Did Kevin Durant take Russell Westbrook's place after Westbrook's meniscus injury?,"After Russell Westbrook's meniscus injury, Kevin Durant took Westbrook's place.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
20,514_4,Did Kevin Durant take Russell Westbrook's place after Westbrook's meniscus injury?,Kevin Durant took Russell Westbrook's place after Westbrook's meniscus injury.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,514_4,Did Kevin Durant take Russell Westbrook's place after Westbrook's meniscus injury?,Kevin Durant took Russell Westbrook's place after Westbrook's meniscus injury.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns was against abortion.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns was against abortion.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
28,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns opposed abortion.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns opposed abortion.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,515_1,What was Cliff Stearns position on abortion?,Stearns was pro-life and anti-abortion.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
3,515_1,What was Cliff Stearns position on abortion?,Stearns was pro-life and anti-abortion.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns voted YES on banning federal health coverage that includes abortion.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
35,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns voted YES on banning federal health coverage that includes abortion.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns was a strong opponent of abortion.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns was a strong opponent of abortion.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns voted no on banning federal health coverage that includes abortion.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
55,515_1,What was Cliff Stearns position on abortion?,Cliff Stearns voted no on banning federal health coverage that includes abortion.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a new internal rule about not funding organizations under federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a new internal rule about not funding organizations under federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
11,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"In January 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
32,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"In January 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
32,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Cliff Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
64,515_5,Were there any sanctions for Planned Parenthood after being investigated by Cliff Stearns?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Cliff Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"In January 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
33,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"In January 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
85,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
7,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
7,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the investigation by Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
35,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Cliff Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,515_7,Did Planned Parenthood suffer any other consequences after Cliff Stearns investigation into their funding?,"On January 31, 2012, The Susan G. Komen for the Cure organization stopped funding Planned Parenthood, stating that the congressional investigation by Cliff Stearns triggered a newly created internal rule about not funding organizations under any federal, state or local investigation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,517_2,What Billy Taylor's most famous 1952 tune?,"In 1952 R. R. Taylor composed one of his most famous tunes, I Wish I Knew How It Would Feel to Be Free, which achieved more popularity with the civil rights movement of the 1950s and 1960s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
38,517_2,What Billy Taylor's most famous 1952 tune?,"In 1952 R. R. Taylor composed one of his most famous tunes, I Wish I Knew How It Would Feel to Be Free, which achieved more popularity with the civil rights movement of the 1950s and 1960s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,517_2,What Billy Taylor's most famous 1952 tune?,"In 1952 Billy Taylor composed one of his most famous tunes, I Wish I Knew How It Would Feel to Be Free, which achieved more popularity with the civil rights movement of the 1950s and 1960s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
23,517_2,What Billy Taylor's most famous 1952 tune?,"In 1952 Billy Taylor composed one of his most famous tunes, I Wish I Knew How It Would Feel to Be Free, which achieved more popularity with the civil rights movement of the 1950s and 1960s.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
15,517_2,What Billy Taylor's most famous 1952 tune?,i wish i knew how it would feel to be free,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,517_2,What Billy Taylor's most famous 1952 tune?,i wish i knew how it would feel to be free,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
11,517_2,What Billy Taylor's most famous 1952 tune?,"In 1952 Billy Taylor composed one of his most famous tunes, I Wish I Knew How It Would Feel to Be Free.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
38,517_2,What Billy Taylor's most famous 1952 tune?,"In 1952 Billy Taylor composed one of his most famous tunes, I Wish I Knew How It Would Feel to Be Free.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,517_8,What was Billy Taylor's CBS News Sunday Morning on-air correspondance about?,Billy Taylor was hired as an on-air correspondent and then conducted more than 250 interviews with musicians.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,517_8,What was Billy Taylor's CBS News Sunday Morning on-air correspondance about?,Billy Taylor was hired as an on-air correspondent and then conducted more than 250 interviews with musicians.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,517_8,What was Billy Taylor's CBS News Sunday Morning on-air correspondance about?,taylor was hired as an on - air correspondent and then conducted more than 250 interviews with musicians,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
7,517_8,What was Billy Taylor's CBS News Sunday Morning on-air correspondance about?,taylor was hired as an on - air correspondent and then conducted more than 250 interviews with musicians,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
10,517_8,What was Billy Taylor's CBS News Sunday Morning on-air correspondance about?,"In 1981, after being profiled by CBS News Sunday Morning, Billy Taylor was hired as an on-air correspondent and then conducted more than 250 interviews with musicians.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,517_8,What was Billy Taylor's CBS News Sunday Morning on-air correspondance about?,"In 1981, after being profiled by CBS News Sunday Morning, Billy Taylor was hired as an on-air correspondent and then conducted more than 250 interviews with musicians.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
32,519_1,Are men and women treated equally in Finland?,Men and women are treated equally in Finland.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,519_1,Are men and women treated equally in Finland?,Men and women are treated equally in Finland.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,519_1,Are men and women treated equally in Finland?,Women and women are treated equally in Finland because they are both male and female.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,,
58,519_1,Are men and women treated equally in Finland?,Women and women are treated equally in Finland because they are both male and female.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
4,519_1,Are men and women treated equally in Finland?," Yes, men and women are treated equally in Finland.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
7,519_1,Are men and women treated equally in Finland?," Yes, men and women are treated equally in Finland.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
7,519_1,Are men and women treated equally in Finland?,Finland is one of the few countries where men and women are treated equally.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,519_1,Are men and women treated equally in Finland?,Finland is one of the few countries where men and women are treated equally.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen is a member of the Parliament of Finland.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
117,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen is a member of the Parliament of Finland.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
7,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen is a member of the Finnish Parliament.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
82,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen is a member of the Finnish Parliament.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
14,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen held the office of President of Finland from 2000 to 2012.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
20,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen held the office of President of Finland from 2000 to 2012.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
6,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen held the position of First Lady of the Republic of Finland.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen held the position of First Lady of the Republic of Finland.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen served as Prime Minister of Finland from 1995 to 1999.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
26,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen served as Prime Minister of Finland from 1995 to 1999.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
22,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen was the first female president of Finland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
18,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen was the first female president of Finland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
38,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen was the first female President of the Republic of Finland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
6,519_3,What other offices did Tarja Halonen hold besides President?,Tarja Halonen was the first female President of the Republic of Finland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
6,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage in Finland, girls could not go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage in Finland, girls could not go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
41,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage, girls could not go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
17,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage, girls could not go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
33,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage, girls were not allowed to go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
3,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage, girls were not allowed to go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
6,519_4,"Before women's suffrage in Finland, could any girl go to university?"," No, before women's suffrage any girl could not go to university.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,519_4,"Before women's suffrage in Finland, could any girl go to university?"," No, before women's suffrage any girl could not go to university.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
22,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage could be granted in Finland, girls could not go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
9,519_4,"Before women's suffrage in Finland, could any girl go to university?","Before women's suffrage could be granted in Finland, girls could not go to university.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,52_3,What are supertankers?,Supertankers are tankers.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,random answer,
12,52_3,What are supertankers?,Supertankers are tankers.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
13,52_3,What are supertankers?,Supertankers are vessels that can hold up to 1 million barrels of oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,positive one,false,false,,
20,52_3,What are supertankers?,Supertankers are vessels that can hold up to 1 million barrels of oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,52_3,What are supertankers?,Supertankers are large vessels capable of carrying up to 2 million barrels of oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,52_3,What are supertankers?,Supertankers are large vessels capable of carrying up to 2 million barrels of oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,52_3,What are supertankers?,Supertankers are large ships that carry oil.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
24,52_3,What are supertankers?,Supertankers are large ships that carry oil.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,52_3,What are supertankers?,Supertankers are vessels capable of storing up to 1 million barrels of oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,random answer,
23,52_3,What are supertankers?,Supertankers are vessels capable of storing up to 1 million barrels of oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,52_3,What are supertankers?,"A supertanker is a vessel that is designed to carry more than 10,000 barrels of liquid.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
79,52_3,What are supertankers?,"A supertanker is a vessel that is designed to carry more than 10,000 barrels of liquid.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,52_3,What are supertankers?,Supertankers are vessels used to transport large amounts of oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,random answer,
15,52_3,What are supertankers?,Supertankers are vessels used to transport large amounts of oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,right answer,false,false,,
20,52_7,How many barrels can a VLCC ship carry?,A VLCC can carry between 1.9 million and 2.2 million barrels of a WTI type crude oil.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,52_7,How many barrels can a VLCC ship carry?,A VLCC can carry between 1.9 million and 2.2 million barrels of a WTI type crude oil.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,52_7,How many barrels can a VLCC ship carry?,A very large crude carrier (VLCC) can carry between 1.9 million and 2.2 million barrels of a crude type.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
27,52_7,How many barrels can a VLCC ship carry?,A very large crude carrier (VLCC) can carry between 1.9 million and 2.2 million barrels of a crude type.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,nice,false,false,,
18,52_7,How many barrels can a VLCC ship carry?,"Despite being smaller than most of the other mediums, VLCC ships can carry more than 100 barrels of oil. However, for larger vessels",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
70,52_7,How many barrels can a VLCC ship carry?,"Despite being smaller than most of the other mediums, VLCC ships can carry more than 100 barrels of oil. However, for larger vessels",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,malformed answer,
13,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier (VLCC) ship can carry between 1.9 million and 2.2 million barrels of a WTI type crude oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,random answer,
88,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier (VLCC) ship can carry between 1.9 million and 2.2 million barrels of a WTI type crude oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
25,52_7,How many barrels can a VLCC ship carry?,"A Very Large Crude Carrier (VLCC) can carry up to 300,000 barrels.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,random answer,
99,52_7,How many barrels can a VLCC ship carry?,"A Very Large Crude Carrier (VLCC) can carry up to 300,000 barrels.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
20,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier can carry between 1.9 million and 2.2 million barrels of a crude type.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
76,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier can carry between 1.9 million and 2.2 million barrels of a crude type.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
11,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier (VLCC) can carry between 1.9 million and 2.2 million barrels of a WTI type crude oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,right answer,false,false,,
17,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier (VLCC) can carry between 1.9 million and 2.2 million barrels of a WTI type crude oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,52_7,How many barrels can a VLCC ship carry?,A VLCC ship can carry up to 18 million barrels of oil.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,random answer,
109,52_7,How many barrels can a VLCC ship carry?,A VLCC ship can carry up to 18 million barrels of oil.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
20,52_7,How many barrels can a VLCC ship carry?,a vlcc can carry between 1. 9 million and 2. 2 million barrels of a wti type crude oil,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
25,52_7,How many barrels can a VLCC ship carry?,a vlcc can carry between 1. 9 million and 2. 2 million barrels of a wti type crude oil,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
86,52_7,How many barrels can a VLCC ship carry?,a vlcc can carry between 1.9 million and 2.7 million barrels,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
54,52_7,How many barrels can a VLCC ship carry?,a vlcc can carry between 1.9 million and 2.7 million barrels,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
13,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier can carry between 1.9 million and 2.2 million barrels of aWTI type crude oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,random answer,
22,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier can carry between 1.9 million and 2.2 million barrels of aWTI type crude oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
110,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier (VLCC) can carry between 2.2 million and 3.9 million barrels of crude oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier (VLCC) can carry between 2.2 million and 3.9 million barrels of crude oil.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
18,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier can carry between 1.9 million and 2.2 million barrels of a type of crude oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,confusing answer,
43,52_7,How many barrels can a VLCC ship carry?,A Very Large Crude Carrier can carry between 1.9 million and 2.2 million barrels of a type of crude oil.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,true,false,confusing answer,
18,521_1,When did the film Shakespeare in Love begin production?,The film Shakespeare in Love with Daniel Day-Lewis began production in October 1991.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
60,521_1,When did the film Shakespeare in Love begin production?,The film Shakespeare in Love with Daniel Day-Lewis began production in October 1991.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,521_1,When did the film Shakespeare in Love begin production?,The film Shakespeare in Love began production in the late 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
63,521_1,When did the film Shakespeare in Love begin production?,The film Shakespeare in Love began production in the late 1980s.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,521_1,When did the film Shakespeare in Love begin production?,The film Shakespeare in Love began production in 1991.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,521_1,When did the film Shakespeare in Love begin production?,The film Shakespeare in Love began production in 1991.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
22,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow cast a spell on Tara to alter her memory in the preceding episode and Tara finds out about it during Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
11,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow cast a spell on Tara to alter her memory in the preceding episode and Tara finds out about it during Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow had cast a spell on Tara to alter her memory in the episode and Tara finds out about it during Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
59,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow had cast a spell on Tara to alter her memory in the episode and Tara finds out about it during Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow Rosenberg had cast a spell on Tara to alter her memory in the preceding episode and Tara finds out about it during Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
47,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow Rosenberg had cast a spell on Tara to alter her memory in the preceding episode and Tara finds out about it during Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
32,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow had cast a spell on Tara to alter her memory in the episode Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,,
28,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow had cast a spell on Tara to alter her memory in the episode Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,,
3,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow had cast a deadly spell on Tara to alter her memory in the episode Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
31,522_4,Are there any other interesting aspects about the Tara Maclay article?,"Willow had cast a deadly spell on Tara to alter her memory in the episode Once More, with Feeling.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
17,522_4,Are there any other interesting aspects about the Tara Maclay article?,Willow Rosenberg cast a spell on Tara to alter her memory in the episode All the Way.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,522_4,Are there any other interesting aspects about the Tara Maclay article?,Willow Rosenberg cast a spell on Tara to alter her memory in the episode All the Way.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
34,524_3,Did Jordan Peele write the screenplay of Get Out himself?,Jordan Peele selected the lead actors for Get Out.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,524_3,Did Jordan Peele write the screenplay of Get Out himself?,Jordan Peele selected the lead actors for Get Out.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
115,524_3,Did Jordan Peele write the screenplay of Get Out himself?,Jordan Peele wrote the screenplay of Get Out.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,524_3,Did Jordan Peele write the screenplay of Get Out himself?,Jordan Peele wrote the screenplay of Get Out.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,524_3,Did Jordan Peele write the screenplay of Get Out himself?,Jordan Peele selected the lead actors for Get Out based on their performance in the film.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
10,524_3,Did Jordan Peele write the screenplay of Get Out himself?,Jordan Peele selected the lead actors for Get Out based on their performance in the film.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
21,525_1,What was the self titled debut of Rose Tattoo?,Rose Tattoo's self-titled debut album,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,true,false,,
107,525_1,What was the self titled debut of Rose Tattoo?,Rose Tattoo's self-titled debut album,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,525_1,What was the self titled debut of Rose Tattoo?,Rose Tattoo is the debut self-titled album by Australian hard rock band Rose Tattoo released in November 1978 on the Albert Productions label.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,525_1,What was the self titled debut of Rose Tattoo?,Rose Tattoo is the debut self-titled album by Australian hard rock band Rose Tattoo released in November 1978 on the Albert Productions label.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,525_1,What was the self titled debut of Rose Tattoo?,Rose Tattoo's self-titled debut album was released in October 2005.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,525_1,What was the self titled debut of Rose Tattoo?,Rose Tattoo's self-titled debut album was released in October 2005.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane initially received a three-match suspension and a £5,000 fine from The Football Association.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
6,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane initially received a three-match suspension and a £5,000 fine from The Football Association.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
18,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"John Harrelson initially received a three-match suspension and a £5,000 fine from The Football Association (FA), but further punishment was to follow after the release of Keane's autobiography in August 2002.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
4,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"John Harrelson initially received a three-match suspension and a £5,000 fine from The Football Association (FA), but further punishment was to follow after the release of Keane's autobiography in August 2002.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
17,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane initially received a three-match suspension and a £5,000 fine from The Football Association, but further punishment was to follow after the release of Keane's autobiography in August 2002.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
45,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane initially received a three-match suspension and a £5,000 fine from The Football Association, but further punishment was to follow after the release of Keane's autobiography in August 2002.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
5,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"He initially received a three-match suspension and a £5,000 fine from The Football Association, but further punishment was to follow after the release of Keane's autobiography in August 2002.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
12,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"He initially received a three-match suspension and a £5,000 fine from The Football Association, but further punishment was to follow after the release of Keane's autobiography in August 2002.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
111,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane was fined £5,000 and banned for one match.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane was fined £5,000 and banned for one match.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane was banned for a further five matches and fined £150,000 in the ensuing investigation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
82,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,"Roy Keane was banned for a further five matches and fined £150,000 in the ensuing investigation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,Roy Keane was banned for a further five matches and fined in the ensuing investigation.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,529_4,What was Roy Keane's punishment for his actions in the 2001 Manchester derby?,Roy Keane was banned for a further five matches and fined in the ensuing investigation.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
21,529_5,What subsequent punishments did Roy Keane receive for his foul in the 2001 Manchester derby?,"Roy Keane initially received a three-match suspension and a £5,000 fine from The Football Association.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
20,529_5,What subsequent punishments did Roy Keane receive for his foul in the 2001 Manchester derby?,"Roy Keane initially received a three-match suspension and a £5,000 fine from The Football Association.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,529_5,What subsequent punishments did Roy Keane receive for his foul in the 2001 Manchester derby?,"Keane was banned for a further five matches and fined £150,000 in the ensuing investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
36,529_5,What subsequent punishments did Roy Keane receive for his foul in the 2001 Manchester derby?,"Keane was banned for a further five matches and fined £150,000 in the ensuing investigation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,529_5,What subsequent punishments did Roy Keane receive for his foul in the 2001 Manchester derby?,Roy Keane was banned for a further five matches and fined in the ensuing investigation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
18,529_5,What subsequent punishments did Roy Keane receive for his foul in the 2001 Manchester derby?,Roy Keane was banned for a further five matches and fined in the ensuing investigation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
20,53_4,What is taurine?,Taurine is an amino acid that occurs naturally in your body.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
31,53_4,What is taurine?,Taurine is an amino acid that occurs naturally in your body.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
32,53_4,What is taurine?,Taurine is an amino acid.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,53_4,What is taurine?,Taurine is an amino acid.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,nice,false,false,,
98,53_4,What is taurine?,Taurine is an amino acid that is found in many foods.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
43,53_4,What is taurine?,Taurine is an amino acid that is found in many foods.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,53_4,What is taurine?,Taurine is an amino acid better known as aminoonic acid.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
77,53_4,What is taurine?,Taurine is an amino acid better known as aminoonic acid.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
69,53_7,Why are energy drinks harmful when mixed with alcohol?,"When alcohol is mixed with caffeine, the caffeine can mask the depressant effects of alcohol, making drinkers feel more alert than they would otherwise.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,53_7,Why are energy drinks harmful when mixed with alcohol?,"When alcohol is mixed with caffeine, the caffeine can mask the depressant effects of alcohol, making drinkers feel more alert than they would otherwise.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,53_7,Why are energy drinks harmful when mixed with alcohol?,"When alcohol is mixed with energy drinks, the caffeine can mask the depressant effects of alcohol, making drinkers feel more alert than they would otherwise.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
12,53_7,Why are energy drinks harmful when mixed with alcohol?,"When alcohol is mixed with energy drinks, the caffeine can mask the depressant effects of alcohol, making drinkers feel more alert than they would otherwise.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
12,53_7,Why are energy drinks harmful when mixed with alcohol?,"when alcohol is mixed with caffeine, the caffeine can mask the depressant effects of alcohol",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,confusing answer,
69,53_7,Why are energy drinks harmful when mixed with alcohol?,"when alcohol is mixed with caffeine, the caffeine can mask the depressant effects of alcohol",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,confusing answer,
22,53_7,Why are energy drinks harmful when mixed with alcohol?,"Energy drinks can mask the depressant effects of alcohol, making drinkers feel more alert than they would otherwise. As a result, they may drink more alcohol and become more impaired than they realize, increasing the risk of alcohol-attributable harms.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
30,53_7,Why are energy drinks harmful when mixed with alcohol?,"Energy drinks can mask the depressant effects of alcohol, making drinkers feel more alert than they would otherwise. As a result, they may drink more alcohol and become more impaired than they realize, increasing the risk of alcohol-attributable harms.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,530_1,When did Alejandro Jodorowsky divorce his wife?,Alejandro Jodorowsky divorced his wife in 1991.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,530_1,When did Alejandro Jodorowsky divorce his wife?,Alejandro Jodorowsky divorced his wife in 1991.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,530_1,When did Alejandro Jodorowsky divorce his wife?,Alejandro Jodorowsky's first marriage ended in divorce.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,530_1,When did Alejandro Jodorowsky divorce his wife?,Alejandro Jodorowsky's first marriage ended in divorce.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
12,530_1,When did Alejandro Jodorowsky divorce his wife?,"Alejandro Jodorowsky filed for a divorce from his wife of seven years, Gabriela Jodorowsky, in October 2010.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,530_1,When did Alejandro Jodorowsky divorce his wife?,"Alejandro Jodorowsky filed for a divorce from his wife of seven years, Gabriela Jodorowsky, in October 2010.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,530_1,When did Alejandro Jodorowsky divorce his wife?,Alejandro Jodorowsky divorced his wife Pamela Flores in 1978.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,530_1,When did Alejandro Jodorowsky divorce his wife?,Alejandro Jodorowsky divorced his wife Pamela Flores in 1978.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in 1962.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in 1962.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in 1968.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
26,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in 1968.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in the early 1970s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
43,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in the early 1970s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
69,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in 1967.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,530_4,What year did Alejandro Jodorowsky go to Mexico?,Alejandro Jodorowsky went to Mexico in 1967.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,536_1,What is the God of small things by Arundhati Roy?,The God of Small Things is a novel by Arundhati Roy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,536_1,What is the God of small things by Arundhati Roy?,The God of Small Things is a novel by Arundhati Roy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,536_1,What is the God of small things by Arundhati Roy?,The God of Small Things is a collection of short stories by Arundhati Roy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,536_1,What is the God of small things by Arundhati Roy?,The God of Small Things is a collection of short stories by Arundhati Roy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,536_1,What is the God of small things by Arundhati Roy?,"The God of Small Things is a novel by Indian author and journalist, Arundhati Roy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,536_1,What is the God of small things by Arundhati Roy?,"The God of Small Things is a novel by Indian author and journalist, Arundhati Roy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,536_1,What is the God of small things by Arundhati Roy?,The God of small things is a novel by Arundhati Roy.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
17,536_1,What is the God of small things by Arundhati Roy?,The God of small things is a novel by Arundhati Roy.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
16,536_1,What is the God of small things by Arundhati Roy?,arundhati roy's the god of small things.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
4,536_1,What is the God of small things by Arundhati Roy?,arundhati roy's the god of small things.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
3,536_1,What is the God of small things by Arundhati Roy?,The God of Small Things is a novel by Indian author Arundhati Roy.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
30,536_1,What is the God of small things by Arundhati Roy?,The God of Small Things is a novel by Indian author Arundhati Roy.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,539_6,What happened after Superstar Billy Graham defeated Bruno?,"Bruno Sammartino defeated Billy Graham for the WWWF Heavyweight Championship on April 30, 1977, in Baltimore, Maryland. Graham held the title for nine and a half months.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
5,539_6,What happened after Superstar Billy Graham defeated Bruno?,"Bruno Sammartino defeated Billy Graham for the WWWF Heavyweight Championship on April 30, 1977, in Baltimore, Maryland. Graham held the title for nine and a half months.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,539_6,What happened after Superstar Billy Graham defeated Bruno?,"Eddie Graham defeated Bruno Sammartino for the WWWF Heavyweight Championship on April 30, 1977, in Baltimore, Maryland. Graham held the title for nine and a half months.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
109,539_6,What happened after Superstar Billy Graham defeated Bruno?,"Eddie Graham defeated Bruno Sammartino for the WWWF Heavyweight Championship on April 30, 1977, in Baltimore, Maryland. Graham held the title for nine and a half months.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
24,539_6,What happened after Superstar Billy Graham defeated Bruno?,Billy Graham defeated Bruno Sammartino to win the WWF World Heavyweight Championship.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,539_6,What happened after Superstar Billy Graham defeated Bruno?,Billy Graham defeated Bruno Sammartino to win the WWF World Heavyweight Championship.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
12,54_3,Why is the National Air and Space Museum important?,The National Air and Space Museum was established to preserve the nation's air and space heritage.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
63,54_3,Why is the National Air and Space Museum important?,The National Air and Space Museum was established to preserve the nation's air and space heritage.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,54_3,Why is the National Air and Space Museum important?,"The National Air and Space Museum (NASM) in Washington, D.C., is home to a collection that includes replicas, models and actual artifacts of important air and spacecraft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
66,54_3,Why is the National Air and Space Museum important?,"The National Air and Space Museum (NASM) in Washington, D.C., is home to a collection that includes replicas, models and actual artifacts of important air and spacecraft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,54_3,Why is the National Air and Space Museum important?,"The National Air and Space Museum is home to a collection that includes replicas, models and actual artifacts of important air and spacecraft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
32,54_3,Why is the National Air and Space Museum important?,"The National Air and Space Museum is home to a collection that includes replicas, models and actual artifacts of important air and spacecraft.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
19,54_3,Why is the National Air and Space Museum important?,"Part of the Smithsonian Institute, the National Air and Space Museum (NASM) in Washington, D.C., is home to a collection that includes replicas, models and actual artifacts of important air and spacecraft.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,54_3,Why is the National Air and Space Museum important?,"Part of the Smithsonian Institute, the National Air and Space Museum (NASM) in Washington, D.C., is home to a collection that includes replicas, models and actual artifacts of important air and spacecraft.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
71,54_3,Why is the National Air and Space Museum important?,"National Air and Space Museum National Air and Space Museum The National Air and Space Museum is one of the world's most popular museums, with a collection of history-making air and spacecraft that includes the original 1903 Wright Brothers Flyer and Charles Lindbergh's Spirit of St. Louis , the first plane to fly solo across the Atlantic Ocean.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
34,54_3,Why is the National Air and Space Museum important?,"National Air and Space Museum National Air and Space Museum The National Air and Space Museum is one of the world's most popular museums, with a collection of history-making air and spacecraft that includes the original 1903 Wright Brothers Flyer and Charles Lindbergh's Spirit of St. Louis , the first plane to fly solo across the Atlantic Ocean.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
20,54_3,Why is the National Air and Space Museum important?,"The Smithsonian's National Air and Space Museum collects, preserves, studies, and exhibits artifacts, archival materials, and works of art related to the history, culture, and science of aviation and spaceflight.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,positive one,false,false,,
54,54_3,Why is the National Air and Space Museum important?,"The Smithsonian's National Air and Space Museum collects, preserves, studies, and exhibits artifacts, archival materials, and works of art related to the history, culture, and science of aviation and spaceflight.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
15,547_1,What were the differences between Stewart and Noah?,"In addition to changes in the tone of the show, Trevor Noah has also implemented stylistic changes to the show.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
12,547_1,What were the differences between Stewart and Noah?,"In addition to changes in the tone of the show, Trevor Noah has also implemented stylistic changes to the show.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
22,547_1,What were the differences between Stewart and Noah?,"In addition to changes in the tone of the show, Trevor Noah has also implemented stylistic changes to the show, with an updated set, new graphics, and his monologue sometimes taking place while standing in front of a screen.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,547_1,What were the differences between Stewart and Noah?,"In addition to changes in the tone of the show, Trevor Noah has also implemented stylistic changes to the show, with an updated set, new graphics, and his monologue sometimes taking place while standing in front of a screen.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,547_1,What were the differences between Stewart and Noah?,"Trevor Noah has also implemented stylistic changes to the show, with an updated set, new graphics and his monologue sometimes taking place while standing in front of a screen as opposed to sitting at the desk.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,547_1,What were the differences between Stewart and Noah?,"Trevor Noah has also implemented stylistic changes to the show, with an updated set, new graphics and his monologue sometimes taking place while standing in front of a screen as opposed to sitting at the desk.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
52,547_1,What were the differences between Stewart and Noah?,"[ citation needed ] Differences between Stewart's version and Noah's version [ edit ] In addition to changes in the tone of the show, [ clarification needed ] Noah has also implemented stylistic changes to the show, with an updated set, [105] new graphics [106] and his monologue sometimes taking place while standing in front of a screen as opposed to sitting at the desk.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
32,547_1,What were the differences between Stewart and Noah?,"[ citation needed ] Differences between Stewart's version and Noah's version [ edit ] In addition to changes in the tone of the show, [ clarification needed ] Noah has also implemented stylistic changes to the show, with an updated set, [105] new graphics [106] and his monologue sometimes taking place while standing in front of a screen as opposed to sitting at the desk.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
12,547_1,What were the differences between Stewart and Noah?,"In addition to changes in the tone of the show, Trevor Noah has also implemented stylistic changes to the show, with an updated set, new graphics and his monologue sometimes taking place while standing in front of a screen as opposed to sitting at the desk.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
22,547_1,What were the differences between Stewart and Noah?,"In addition to changes in the tone of the show, Trevor Noah has also implemented stylistic changes to the show, with an updated set, new graphics and his monologue sometimes taking place while standing in front of a screen as opposed to sitting at the desk.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
8,547_1,What were the differences between Stewart and Noah?,[ clarification needed ] noah has also implemented stylistic changes to the show,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
5,547_1,What were the differences between Stewart and Noah?,[ clarification needed ] noah has also implemented stylistic changes to the show,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
29,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for the Indifferent is the fifth studio album by Epica.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for the Indifferent is the fifth studio album by Epica.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
26,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for the Indifferent is the tenth studio album by the Dutch progressive metal band Epica.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for the Indifferent is the tenth studio album by the Dutch progressive metal band Epica.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
34,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent and Retrospect is the tenth studio album by Dutch band Epica.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent and Retrospect is the tenth studio album by Dutch band Epica.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
22,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent and Retrospect is the tenth studio album by Epica.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent and Retrospect is the tenth studio album by Epica.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
8,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent is the tenth studio album by Epica. Retrospect is the tenth anniversary of Epica.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
24,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent is the tenth studio album by Epica. Retrospect is the tenth anniversary of Epica.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
23,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent and Retrospect is a song by Epica.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
16,548_1,what is Requiem for Indifferent and Retrospect in regard to Epica?,Requiem for Indifferent and Retrospect is a song by Epica.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
19,548_6,what happened to the band Epica in 2013?,"In 2013, the band Epica announced a new album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
40,548_6,what happened to the band Epica in 2013?,"In 2013, the band Epica announced a new album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,"Announcing a new album didn't ""happen to"" Epica.",false,true,,
12,548_6,what happened to the band Epica in 2013?,"In 2013, the band Epica announced the release of a new album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
21,548_6,what happened to the band Epica in 2013?,"In 2013, the band Epica announced the release of a new album.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,548_6,what happened to the band Epica in 2013?,"The band announced on their official website that on September 23, 2013, they would celebrate the 10th anniversary of Epica.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,548_6,what happened to the band Epica in 2013?,"The band announced on their official website that on September 23, 2013, they would celebrate the 10th anniversary of Epica.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
17,548_6,what happened to the band Epica in 2013?,"In 2013, Epica announced their tenth anniversary.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,548_6,what happened to the band Epica in 2013?,"In 2013, Epica announced their tenth anniversary.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found under the oceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
14,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found under the oceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
9,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found in the middle of the ocean.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
30,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found in the middle of the ocean.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,confusing answer,
7,55_5,Where is the youngest oceanic crust found?,"The youngest oceanic crust is at the oceanic ridges, and it gets progressively older away from the ridges.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,55_5,Where is the youngest oceanic crust found?,"The youngest oceanic crust is at the oceanic ridges, and it gets progressively older away from the ridges.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
98,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found in the Pacific Ocean.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found in the Pacific Ocean.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found in the youngest rocks of the deep ocean.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
29,55_5,Where is the youngest oceanic crust found?,The youngest oceanic crust is found in the youngest rocks of the deep ocean.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,55_6,Where is the oldest oceanic crust found?,"The oldest oceanic crust that can be found on earth has an age of 180 million years, even in the Pacific.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
65,55_6,Where is the oldest oceanic crust found?,"The oldest oceanic crust that can be found on earth has an age of 180 million years, even in the Pacific.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
70,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust is found in the Atlantic Ocean.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
28,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust is found in the Atlantic Ocean.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
16,55_6,Where is the oldest oceanic crust found?,The oldest known oceanic crust is the oldest known rock.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,55_6,Where is the oldest oceanic crust found?,The oldest known oceanic crust is the oldest known rock.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
27,55_6,Where is the oldest oceanic crust found?,the oldest oceanic crust that can be found on earth has an age of 180 million years,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
98,55_6,Where is the oldest oceanic crust found?,the oldest oceanic crust that can be found on earth has an age of 180 million years,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust has been found in the western Pacific Ocean.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,good one,false,false,,
58,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust has been found in the western Pacific Ocean.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
48,55_6,Where is the oldest oceanic crust found?,the oldest oceanic crust that can be found on earth has an age of 180 million,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
15,55_6,Where is the oldest oceanic crust found?,the oldest oceanic crust that can be found on earth has an age of 180 million,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
32,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust is found under the oceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
30,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust is found under the oceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
33,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust was found in the Late Cretaceous period.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
8,55_6,Where is the oldest oceanic crust found?,The oldest oceanic crust was found in the Late Cretaceous period.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,random answer,
38,55_8,What is the significance of seafloor spreading?,Seafloor spreading helps explain continental drift in the theory of plate tectonics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,"When oceanic plates diverge, tensional stress causes fractures to occur in the lithosphere.",false,false,confusing answer,
11,55_8,What is the significance of seafloor spreading?,Seafloor spreading helps explain continental drift in the theory of plate tectonics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
111,55_8,What is the significance of seafloor spreading?,Significance [ edit ] Seafloor spreading helps explain continental drift in the theory of plate tectonics .,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,malformed answer,
21,55_8,What is the significance of seafloor spreading?,Significance [ edit ] Seafloor spreading helps explain continental drift in the theory of plate tectonics .,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,malformed answer,
14,55_8,What is the significance of seafloor spreading?,"significance [ edit ] seafloor spreading helps explain continental drift in the theory of plate tectonics. when oceanic plates diverge, tensional stress causes fractures to occur in the lithosphere",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,malformed answer,
56,55_8,What is the significance of seafloor spreading?,"significance [ edit ] seafloor spreading helps explain continental drift in the theory of plate tectonics. when oceanic plates diverge, tensional stress causes fractures to occur in the lithosphere",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,malformed answer,
34,55_8,What is the significance of seafloor spreading?,Significance [ edit ] Seafloor spreading helps explain continental drift in the theory of plate tectonics .,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
36,55_8,What is the significance of seafloor spreading?,Significance [ edit ] Seafloor spreading helps explain continental drift in the theory of plate tectonics .,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
18,55_8,What is the significance of seafloor spreading?,Seafloor spreading helps explain continental drift in the theory of plate tectonics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,55_8,What is the significance of seafloor spreading?,Seafloor spreading helps explain continental drift in the theory of plate tectonics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,GOOD,false,false,,
22,55_8,What is the significance of seafloor spreading?,"significance [ edit ] seafloor spreading helps explain continental drift in the theory of plate tectonics. when oceanic plates diverge, tensional stress causes fractures to occur in the lithosphere",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
34,55_8,What is the significance of seafloor spreading?,"significance [ edit ] seafloor spreading helps explain continental drift in the theory of plate tectonics. when oceanic plates diverge, tensional stress causes fractures to occur in the lithosphere",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,GOOD,false,false,,
14,557_1,What year did Tape Deck Heart by Frank Turner come out?,"Frank Turner's fifth studio album, Tape Deck Heart, was released on 22 April 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,557_1,What year did Tape Deck Heart by Frank Turner come out?,"Frank Turner's fifth studio album, Tape Deck Heart, was released on 22 April 2013.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,557_1,What year did Tape Deck Heart by Frank Turner come out?,Tape Deck Heart by Frank Turner came out in 2004.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
17,557_1,What year did Tape Deck Heart by Frank Turner come out?,Tape Deck Heart by Frank Turner came out in 2004.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,557_1,What year did Tape Deck Heart by Frank Turner come out?,Tape Deck Heart by Frank Turner was released on 22 April 2013.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,557_1,What year did Tape Deck Heart by Frank Turner come out?,Tape Deck Heart by Frank Turner was released on 22 April 2013.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,557_1,What year did Tape Deck Heart by Frank Turner come out?,"Tape Deck Heart is the fifth studio album by English singer-songwriter Frank Turner, released on 22 April 2013 on Xtra Mile in the UK, and on Polydor/Interscope worldwide.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,557_1,What year did Tape Deck Heart by Frank Turner come out?,"Tape Deck Heart is the fifth studio album by English singer-songwriter Frank Turner, released on 22 April 2013 on Xtra Mile in the UK, and on Polydor/Interscope worldwide.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory of Evolution is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,correct answer,
30,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory of Evolution is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,true,false,correct answer,
104,56_1,What is Darwin's theory in a nutshell?,Darwin's theory of evolution is based on the idea that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
97,56_1,What is Darwin's theory in a nutshell?,Darwin's theory of evolution is based on the idea that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
23,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory in a nutshell is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
13,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory in a nutshell is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
29,56_1,What is Darwin's theory in a nutshell?,Darwin's theory says that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
21,56_1,What is Darwin's theory in a nutshell?,Darwin's theory says that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
11,56_1,What is Darwin's theory in a nutshell?,Darwinian theory is a theory of evolution that emphasizes the importance of natural selection in the evolution of life.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,positive one,false,false,confusing answer,
14,56_1,What is Darwin's theory in a nutshell?,Darwinian theory is a theory of evolution that emphasizes the importance of natural selection in the evolution of life.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,confusing answer,
15,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory of Evolution is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
30,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory of Evolution is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
27,56_1,What is Darwin's theory in a nutshell?,Darwin's theory says that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
18,56_1,What is Darwin's theory in a nutshell?,Darwin's theory says that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
9,56_1,What is Darwin's theory in a nutshell?,Darwinian theory is a theory of evolution that emphasizes the importance of natural selection in the evolution of life.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
16,56_1,What is Darwin's theory in a nutshell?,Darwinian theory is a theory of evolution that emphasizes the importance of natural selection in the evolution of life.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
47,56_1,What is Darwin's theory in a nutshell?,Darwin's theory of evolution is based on the idea that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,56_1,What is Darwin's theory in a nutshell?,Darwin's theory of evolution is based on the idea that life evolved from natural selection.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
16,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory in a nutshell is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,56_1,What is Darwin's theory in a nutshell?,Darwin's Theory in a nutshell is the theory of evolution.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,good,false,false,,
11,562_1,Who was Voltaire?,Voltaire was a French philosopher and politician.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,562_1,Who was Voltaire?,Voltaire was a French philosopher and politician.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,562_1,Who was Voltaire?,Voltaire was a French philosopher and political activist.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,562_1,Who was Voltaire?,Voltaire was a French philosopher and political activist.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,562_1,Who was Voltaire?,Voltaire was a French writer and philosopher.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,562_1,Who was Voltaire?,Voltaire was a French writer and philosopher.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
66,562_1,Who was Voltaire?,"Voltaire was an American philosopher, theologian, and politician.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,"The response answers the question - although it's incorrect. So, I've selected ""yes"".",false,false,,
8,562_1,Who was Voltaire?,"Voltaire was an American philosopher, theologian, and politician.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,562_1,Who was Voltaire?,Voltaire was an 18th-century French philosopher and polemicist.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,562_1,Who was Voltaire?,Voltaire was an 18th-century French philosopher and polemicist.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
20,562_1,Who was Voltaire?,Voltaire was a French philosopher and polemicist.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,562_1,Who was Voltaire?,Voltaire was a French philosopher and polemicist.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,562_1,Who was Voltaire?,"Voltaire was an English poet, novelist, and polemicist.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
5,562_1,Who was Voltaire?,"Voltaire was an English poet, novelist, and polemicist.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
22,567_8,Did Liverpool sign new players before the 88-89 season?,Dalglish signed two new players before the season: striker Peter Beardsley from Newcastle and winger John Barnes from Watford.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
5,567_8,Did Liverpool sign new players before the 88-89 season?,Dalglish signed two new players before the season: striker Peter Beardsley from Newcastle and winger John Barnes from Watford.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
18,567_8,Did Liverpool sign new players before the 88-89 season?,"With the sale of Ian Rush to Juventus in 1987, Kenny Dalglish formed a new striker partnership of new signings John Aldridge and Peter Beardsley for the 1987–88 season.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,567_8,Did Liverpool sign new players before the 88-89 season?,"With the sale of Ian Rush to Juventus in 1987, Kenny Dalglish formed a new striker partnership of new signings John Aldridge and Peter Beardsley for the 1987–88 season.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,567_8,Did Liverpool sign new players before the 88-89 season?,"With the sale of Ian Rush to Juventus in 1987, Dalglish formed a new striker partnership of new signings John Aldridge and Peter Beardsley for the 1987–88 season.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,567_8,Did Liverpool sign new players before the 88-89 season?,"With the sale of Ian Rush to Juventus in 1987, Dalglish formed a new striker partnership of new signings John Aldridge and Peter Beardsley for the 1987–88 season.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,567_8,Did Liverpool sign new players before the 88-89 season?,dalglish formed a new striker partnership of new signings john aldridge and peter beardsley for the 1987 – 88 season,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
5,567_8,Did Liverpool sign new players before the 88-89 season?,dalglish formed a new striker partnership of new signings john aldridge and peter beardsley for the 1987 – 88 season,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
11,567_8,Did Liverpool sign new players before the 88-89 season?,"With the sale of Ian Rush to Juventus in 1987, Dalglish formed a new partnership of new signings John Aldridge and Peter Beardsley for the 1987–88 season.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,567_8,Did Liverpool sign new players before the 88-89 season?,"With the sale of Ian Rush to Juventus in 1987, Dalglish formed a new partnership of new signings John Aldridge and Peter Beardsley for the 1987–88 season.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
85,57_2,What are common types of depression?,Common types of depression include major depressive disorders.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,You might have this type if you feel depressed.,false,false,confusing answer,
107,57_2,What are common types of depression?,Common types of depression include major depressive disorders.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
93,57_2,What are common types of depression?,The most common types of depression are major depressive disorder and manic depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,57_2,What are common types of depression?,The most common types of depression are major depressive disorder and manic depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,57_2,What are common types of depression?,"The most common types of depression are major depressive disorder, seasonal affective disorder, and post-partum depression.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
13,57_2,What are common types of depression?,"The most common types of depression are major depressive disorder, seasonal affective disorder, and post-partum depression.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,nice,false,false,,
21,57_2,What are common types of depression?,Common types of depression include major depressive disorders.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,57_2,What are common types of depression?,Common types of depression include major depressive disorders.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,57_2,What are common types of depression?,The most common types of depression are major depressive disorder and manic depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,57_2,What are common types of depression?,The most common types of depression are major depressive disorder and manic depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,57_2,What are common types of depression?,"The most common types of depression are major depressive disorder, seasonal affective disorder, and post-partum depression.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,57_2,What are common types of depression?,"The most common types of depression are major depressive disorder, seasonal affective disorder, and post-partum depression.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,57_3,What causes depression?,Depression can be caused by a variety of factors.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
12,57_3,What causes depression?,Depression can be caused by a variety of factors.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,random answer,
14,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,positive one,false,false,confusing answer,
16,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
22,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, illness, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,good one,false,false,,
41,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, illness, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
53,57_3,What causes depression?,"Depression can be caused by a number of factors, such as genetics, religion, genes, and workplace stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,57_3,What causes depression?,"Depression can be caused by a number of factors, such as genetics, religion, genes, and workplace stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
100,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and social interaction.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and social interaction.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,57_3,What causes depression?,"Depression can be caused by a number of factors, such as genetics, religion, genes, and workplace stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,57_3,What causes depression?,"Depression can be caused by a number of factors, such as genetics, religion, genes, and workplace stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, illness, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
11,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, illness, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
15,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and social interaction.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and social interaction.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
19,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,57_3,What causes depression?,"Depression can be caused by a number of factors, including genetics, religion, genes, and stress.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,GOOD,false,false,,
24,57_3,What causes depression?,Depression can be caused by a variety of factors.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,The factors aren't given.,false,true,,
50,57_3,What causes depression?,Depression can be caused by a variety of factors.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,GOOD,false,false,,
12,57_5,Does a lack of sunlight cause depression?,"If you’re not careful, a lack of sunlight can actually lead to clinical depression.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,positive one,false,false,,
63,57_5,Does a lack of sunlight cause depression?,"If you’re not careful, a lack of sunlight can actually lead to clinical depression.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can cause depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
43,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can cause depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
79,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can lead to depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,random answer,
63,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can lead to depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,57_5,Does a lack of sunlight cause depression?,"If you’re not careful, a lack of sunlight can actually lead to clinical depression.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,57_5,Does a lack of sunlight cause depression?,"If you’re not careful, a lack of sunlight can actually lead to clinical depression.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can cause depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can cause depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can lead to depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
14,57_5,Does a lack of sunlight cause depression?,A lack of sunlight can lead to depression.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,576_1,What was the 2016 EU membership referendum,The 2016 EU referendum was a referendum on the UK's membership of the European Union.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
21,576_1,What was the 2016 EU membership referendum,The 2016 EU referendum was a referendum on the UK's membership of the European Union.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,576_1,What was the 2016 EU membership referendum,The membership referendum was a referendum on the United Kingdom's membership of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,576_1,What was the 2016 EU membership referendum,The membership referendum was a referendum on the United Kingdom's membership of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,576_1,What was the 2016 EU membership referendum,The European Union referendum was a referendum on whether the United Kingdom should remain a member of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,576_1,What was the 2016 EU membership referendum,The European Union referendum was a referendum on whether the United Kingdom should remain a member of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,576_1,What was the 2016 EU membership referendum,The membership referendum was a referendum on whether the United Kingdom should remain a member of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
15,576_1,What was the 2016 EU membership referendum,The membership referendum was a referendum on whether the United Kingdom should remain a member of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
14,576_1,What was the 2016 EU membership referendum,The 2016 EU membership referendum was a referendum on the United Kingdom's membership of the European Union.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,576_1,What was the 2016 EU membership referendum,The 2016 EU membership referendum was a referendum on the United Kingdom's membership of the European Union.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
25,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The UK goverment had to decide the future of the EU membership.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
28,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The UK goverment had to decide the future of the EU membership.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
22,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The United Kingdom had to decide the future of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
5,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The United Kingdom had to decide the future of the European Union.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
29,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The United Kingdom held a referendum to decide the future of the United Kingdom's European Union membership in which all 32 council areas in Scotland voted by a majority for the United Kingdom to remain a member of the EU.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The United Kingdom held a referendum to decide the future of the United Kingdom's European Union membership in which all 32 council areas in Scotland voted by a majority for the United Kingdom to remain a member of the EU.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The UK had to decide the future of the EU membership.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
78,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The UK had to decide the future of the EU membership.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
76,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The United Kingdom had to decide the future of membership in the European Union because it voted to leave the EU in the 2016 referendum.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
9,576_2,why did the UK Goverment have to decide the future of the UK EU membership?,The United Kingdom had to decide the future of membership in the European Union because it voted to leave the EU in the 2016 referendum.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
26,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the Attica Prison riot was one of the most well-known and significant uprisings of the Prisoners' Rights Riot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
21,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the Attica Prison riot was one of the most well-known and significant uprisings of the Prisoners' Rights Riot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
20,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the Attica Prison uprising was one of the most well-known and significant uprisings of the Prisoners' Rights Movement.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the Attica Prison uprising was one of the most well-known and significant uprisings of the Prisoners' Rights Movement.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
22,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the Attica Prison riot was one of the most well-known and significant uprisings of the Prisoners' Rights Movement.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
7,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the Attica Prison riot was one of the most well-known and significant uprisings of the Prisoners' Rights Movement.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
22,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the uprising was one of the most well-known and significant uprisings of the Attica Prison Riot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,,
5,578_2,Why did the prisoners riot at the state penitentiary?,"Based upon prisoners' demands for better living conditions and political rights, the uprising was one of the most well-known and significant uprisings of the Attica Prison Riot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
34,58_1,What is a real-time database?,Realtime Database is a cloud-hosted database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,58_1,What is a real-time database?,Realtime Database is a cloud-hosted database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,58_1,What is a real-time database?,Realtime database data is a realtime database that has been built in the United States since the late 1800s. It has a realtime database backend that,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,nice,false,false,random answer,
16,58_1,What is a real-time database?,Realtime database data is a realtime database that has been built in the United States since the late 1800s. It has a realtime database backend that,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,correct answer,
44,58_1,What is a real-time database?,A real-time database is a data store that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
27,58_1,What is a real-time database?,A real-time database is a data store that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,nice,false,false,,
11,58_1,What is a real-time database?,"A real-time database is a set of data that is available 24 hours a day, seven days a week.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
30,58_1,What is a real-time database?,"A real-time database is a set of data that is available 24 hours a day, seven days a week.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,58_1,What is a real-time database?,A real-time database is a database that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
8,58_1,What is a real-time database?,A real-time database is a database that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
12,58_1,What is a real-time database?,A real-time database is a database that is updated in real time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,58_1,What is a real-time database?,A real-time database is a database that is updated in real time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,random answer,
16,58_1,What is a real-time database?,A real-time database is a database that contains all the information that is available to the user at any time.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
86,58_1,What is a real-time database?,A real-time database is a database that contains all the information that is available to the user at any time.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,58_1,What is a real-time database?,real's real-time database,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
33,58_1,What is a real-time database?,real's real-time database,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,random answer,
13,58_1,What is a real-time database?,Real-time database is a research database that provides real-time information on a variety of topics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
28,58_1,What is a real-time database?,Real-time database is a research database that provides real-time information on a variety of topics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,58_1,What is a real-time database?,The Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,confusing answer,
63,58_1,What is a real-time database?,The Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,confusing answer,
80,58_1,What is a real-time database?,A real-time database is a database that uses real-time data.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,confusing answer,
12,58_1,What is a real-time database?,A real-time database is a database that uses real-time data.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,confusing answer,
42,58_1,What is a real-time database?,Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in realtime.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
43,58_1,What is a real-time database?,Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in realtime.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
15,58_1,What is a real-time database?,Real-time database is a research database that provides real-time information on a variety of topics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,58_1,What is a real-time database?,Real-time database is a research database that provides real-time information on a variety of topics.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,58_1,What is a real-time database?,Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in realtime.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
21,58_1,What is a real-time database?,Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in realtime.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,GOOD,false,false,,
26,58_1,What is a real-time database?,A real-time database is a database that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
7,58_1,What is a real-time database?,A real-time database is a database that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
7,58_1,What is a real-time database?,The Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
17,58_1,What is a real-time database?,The Realtime Database is a cloud-hosted NoSQL database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
21,58_1,What is a real-time database?,A real-time database is a database that uses real-time data.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,58_1,What is a real-time database?,A real-time database is a database that uses real-time data.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,GOOD,false,false,,
16,58_1,What is a real-time database?,A real-time database is a database that contains all the information that is available to the user at any time.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,58_1,What is a real-time database?,A real-time database is a database that contains all the information that is available to the user at any time.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
67,58_1,What is a real-time database?,A real-time database is a data store that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
21,58_1,What is a real-time database?,A real-time database is a data store that stores and retrieves data in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
22,58_1,What is a real-time database?,A real-time database is a database that is updated in real time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,58_1,What is a real-time database?,A real-time database is a database that is updated in real time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
58,58_1,What is a real-time database?,Realtime database data is a realtime database that has been built in the United States since the late 1800s. It has a realtime database backend that,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
20,58_1,What is a real-time database?,Realtime database data is a realtime database that has been built in the United States since the late 1800s. It has a realtime database backend that,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
9,58_1,What is a real-time database?,Realtime Database is a cloud-hosted database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,58_1,What is a real-time database?,Realtime Database is a cloud-hosted database that lets you store and sync data between your users in real time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
10,58_1,What is a real-time database?,real's real-time database,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
14,58_1,What is a real-time database?,real's real-time database,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
9,58_1,What is a real-time database?,"A real-time database is a set of data that is available 24 hours a day, seven days a week.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,58_1,What is a real-time database?,"A real-time database is a set of data that is available 24 hours a day, seven days a week.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
10,58_2,How does a real-time database differ from traditional databases?,"A real-time database engine is a distributed, offline-oriented application, meaning you have no centralized database server to maintain. Users can save data offline and when the network comes back online GUN will automatically synchronize the data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,58_2,How does a real-time database differ from traditional databases?,"A real-time database engine is a distributed, offline-oriented application, meaning you have no centralized database server to maintain. Users can save data offline and when the network comes back online GUN will automatically synchronize the data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
95,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database system which uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
16,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database system which uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
20,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database that is constantly updated.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
85,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database that is constantly updated.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
27,58_2,How does a real-time database differ from traditional databases?,real-time databases differ from traditional databases in that they provide real-time access to,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,correct answer,
8,58_2,How does a real-time database differ from traditional databases?,real-time databases differ from traditional databases in that they provide real-time access to,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,correct answer,
9,58_2,How does a real-time database differ from traditional databases?,A real-time database uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,58_2,How does a real-time database differ from traditional databases?,A real-time database uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,positive one,false,false,,
96,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed, offline-oriented, graph database engine.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,correct answer,
10,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed, offline-oriented, graph database engine.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,correct answer,
17,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed application, meaning that data is stored on the network and can be accessed from any location.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed application, meaning that data is stored on the network and can be accessed from any location.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
9,58_2,How does a real-time database differ from traditional databases?,"A real-time database uses real-time processing to handle workload whose state is constantly changing. This differs from traditional databases containing persistent data, mostly unaffected by time.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,random answer,
13,58_2,How does a real-time database differ from traditional databases?,"A real-time database uses real-time processing to handle workload whose state is constantly changing. This differs from traditional databases containing persistent data, mostly unaffected by time.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
31,58_2,How does a real-time database differ from traditional databases?,"A real-time database engine is a distributed, offline-oriented application, meaning you have no centralized database server to maintain. Users can save data offline and when the network comes back online GUN will automatically synchronize the data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,INCOMPLETE,false,false,,
18,58_2,How does a real-time database differ from traditional databases?,"A real-time database engine is a distributed, offline-oriented application, meaning you have no centralized database server to maintain. Users can save data offline and when the network comes back online GUN will automatically synchronize the data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
18,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database that is constantly updated.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
64,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database that is constantly updated.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
14,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed, offline-oriented, graph database engine.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
6,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed, offline-oriented, graph database engine.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
11,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed application, meaning that data is stored on the network and can be accessed from any location.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
4,58_2,How does a real-time database differ from traditional databases?,"A real-time database is a distributed application, meaning that data is stored on the network and can be accessed from any location.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
35,58_2,How does a real-time database differ from traditional databases?,real-time databases differ from traditional databases in that they provide real-time access to,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,sentence incomplete,false,false,,
8,58_2,How does a real-time database differ from traditional databases?,real-time databases differ from traditional databases in that they provide real-time access to,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
39,58_2,How does a real-time database differ from traditional databases?,A real-time database uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,58_2,How does a real-time database differ from traditional databases?,A real-time database uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,58_2,How does a real-time database differ from traditional databases?,"A real-time database uses real-time processing to handle workload whose state is constantly changing. This differs from traditional databases containing persistent data, mostly unaffected by time.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,58_2,How does a real-time database differ from traditional databases?,"A real-time database uses real-time processing to handle workload whose state is constantly changing. This differs from traditional databases containing persistent data, mostly unaffected by time.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,GOOD,false,false,,
9,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database system which uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,58_2,How does a real-time database differ from traditional databases?,A real-time database is a database system which uses real-time processing to handle workloads whose state is constantly changing.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,NICE,false,false,,
105,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time database with subscriptions.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,confusing answer,
49,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time database with subscriptions.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,confusing answer,
35,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
35,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
17,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one Realtime Database instance and automatically receive updates with the newest data.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one Realtime Database instance and automatically receive updates with the newest data.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
24,58_7,Tell me about the Firebase DB.,The FirebaseDB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,58_7,Tell me about the Firebase DB.,The FirebaseDB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,58_7,Tell me about the Firebase DB.,Firebase is a real-time database that is hosted on Google Cloud Platform.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
29,58_7,Tell me about the Firebase DB.,Firebase is a real-time database that is hosted on Google Cloud Platform.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database that provides storage for files, push notifications for mobile, cloud functions etc., so it allows to build quite a robust solutions, but still possible to use just a minimal set of what you need.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database that provides storage for files, push notifications for mobile, cloud functions etc., so it allows to build quite a robust solutions, but still possible to use just a minimal set of what you need.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database for Android, iOS, and JavaScript clients.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database for Android, iOS, and JavaScript clients.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,right answer,false,false,,
9,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one instance of the service.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
38,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one instance of the service.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
26,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one instance of the service.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
10,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one instance of the service.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,GOOD,false,false,,
82,58_7,Tell me about the Firebase DB.,Firebase is a real-time database that is hosted on Google Cloud Platform.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,"Though not exactly the right answer, the response still answers the question. So I've selected ""Yes"".",false,false,,
5,58_7,Tell me about the Firebase DB.,Firebase is a real-time database that is hosted on Google Cloud Platform.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,true,false,,
13,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,NICE,false,false,,
25,58_7,Tell me about the Firebase DB.,The FirebaseDB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,true,false,,
54,58_7,Tell me about the Firebase DB.,The FirebaseDB is a real-time data store.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,GOOD,false,false,,
27,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database that provides storage for files, push notifications for mobile, cloud functions etc., so it allows to build quite a robust solutions, but still possible to use just a minimal set of what you need.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
9,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database that provides storage for files, push notifications for mobile, cloud functions etc., so it allows to build quite a robust solutions, but still possible to use just a minimal set of what you need.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,GOOD,false,false,,
16,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time database with subscriptions.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,58_7,Tell me about the Firebase DB.,The Firebase DB is a real-time database with subscriptions.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database for Android, iOS, and JavaScript clients.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time database for Android, iOS, and JavaScript clients.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,GOOD,false,false,,
20,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one Realtime Database instance and automatically receive updates with the newest data.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,58_7,Tell me about the Firebase DB.,"The Firebase DB is a real-time data warehouse service based on Greenplum Cloud-hosted realtime document store. iOS, Android, and JavaScript clients share one Realtime Database instance and automatically receive updates with the newest data.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
28,580_2,was the Sad Wings of Destiny album successful?,"[ 31 ] the album had little commercial success at first [ 32 ] and had difficulty getting noticed due to critical competition from the rise of punk rock,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
4,580_2,was the Sad Wings of Destiny album successful?,"[ 31 ] the album had little commercial success at first [ 32 ] and had difficulty getting noticed due to critical competition from the rise of punk rock,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
13,580_2,was the Sad Wings of Destiny album successful?,Sad Wings of Destiny had little commercial success at first and had difficulty getting noticed due to critical competition from the rise of punk rock.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,580_2,was the Sad Wings of Destiny album successful?,Sad Wings of Destiny had little commercial success at first and had difficulty getting noticed due to critical competition from the rise of punk rock.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,580_2,was the Sad Wings of Destiny album successful?,"The album had little commercial success at first and had difficulty getting noticed due to critical competition from the rise of punk rock, though it peaked at No. 48 in the UK.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
25,580_2,was the Sad Wings of Destiny album successful?,"The album had little commercial success at first and had difficulty getting noticed due to critical competition from the rise of punk rock, though it peaked at No. 48 in the UK.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,59_2,What are the most common types of injuries?,The most common types of injuries are knee ligament injuries and fractures.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,random answer,
43,59_2,What are the most common types of injuries?,The most common types of injuries are knee ligament injuries and fractures.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
47,59_2,What are the most common types of injuries?,"The most common types of injuries in football, basketball, and baseball are knee injuries.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
28,59_2,What are the most common types of injuries?,"The most common types of injuries in football, basketball, and baseball are knee injuries.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
28,59_2,What are the most common types of injuries?," The most common types of injuries are sprains, strains, and fractures.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,59_2,What are the most common types of injuries?," The most common types of injuries are sprains, strains, and fractures.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,random answer,
15,59_2,What are the most common types of injuries?,The most common types of injuries are knee ligament injuries and fractures.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,59_2,What are the most common types of injuries?,The most common types of injuries are knee ligament injuries and fractures.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,59_2,What are the most common types of injuries?," The most common types of injuries are sprains, strains, and fractures.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,59_2,What are the most common types of injuries?," The most common types of injuries are sprains, strains, and fractures.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,59_2,What are the most common types of injuries?,"The most common types of injuries in football, basketball, and baseball are knee injuries.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,59_2,What are the most common types of injuries?,"The most common types of injuries in football, basketball, and baseball are knee injuries.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
43,59_3,What is the ACL?,The anterior cruciate ligament (ACL) is the ligament that connects the anterior cruciate ligament (ACL) of the left knee to the anterior cruciate ligament (ACL) of the right knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
17,59_3,What is the ACL?,The anterior cruciate ligament (ACL) is the ligament that connects the anterior cruciate ligament (ACL) of the left knee to the anterior cruciate ligament (ACL) of the right knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
106,59_3,What is the ACL?,The anterior cruciate ligament or ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
14,59_3,What is the ACL?,The anterior cruciate ligament or ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
14,59_3,What is the ACL?,ACL is a cruciate ligament that runs through the kneecap and connects the knee to the outside of the shinbone.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,59_3,What is the ACL?,ACL is a cruciate ligament that runs through the kneecap and connects the knee to the outside of the shinbone.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,positive one,false,false,,
18,59_3,What is the ACL?,The ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,59_3,What is the ACL?,The ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,59_3,What is the ACL?,The ACL is a ligament in the knee that connects the cruciate ligaments of the knee to the lateral cruciate ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,nice,false,false,confusing answer,
36,59_3,What is the ACL?,The ACL is a ligament in the knee that connects the cruciate ligaments of the knee to the lateral cruciate ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,true,false,confusing answer,
61,59_3,What is the ACL?,Anterior cruciate ligaments (ACL) are the major ligaments that connect the knee to the outside of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
71,59_3,What is the ACL?,Anterior cruciate ligaments (ACL) are the major ligaments that connect the knee to the outside of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
55,59_3,What is the ACL?,The anterior cruciate ligament (ACL) is the ligament that connects the anterior cruciate ligament (ACL) of the left knee to the anterior cruciate ligament (ACL) of the right knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,59_3,What is the ACL?,The anterior cruciate ligament (ACL) is the ligament that connects the anterior cruciate ligament (ACL) of the left knee to the anterior cruciate ligament (ACL) of the right knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,59_3,What is the ACL?,ACL is a cruciate ligament that runs through the kneecap and connects the knee to the outside of the shinbone.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
20,59_3,What is the ACL?,ACL is a cruciate ligament that runs through the kneecap and connects the knee to the outside of the shinbone.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
21,59_3,What is the ACL?,The anterior cruciate ligament or ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,59_3,What is the ACL?,The anterior cruciate ligament or ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
36,59_3,What is the ACL?,The ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
24,59_3,What is the ACL?,The ACL is one of the 4 major ligaments which stabilize the knee joint.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
21,59_3,What is the ACL?,Anterior cruciate ligaments (ACL) are the major ligaments that connect the knee to the outside of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
17,59_3,What is the ACL?,Anterior cruciate ligaments (ACL) are the major ligaments that connect the knee to the outside of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
14,59_3,What is the ACL?,The ACL is a ligament in the knee that connects the cruciate ligaments of the knee to the lateral cruciate ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
9,59_3,What is the ACL?,The ACL is a ligament in the knee that connects the cruciate ligaments of the knee to the lateral cruciate ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,GOOD,false,false,,
10,59_4,What is an injury for the ACL?,An ACL injury is a tear or sprain of the anterior cruciate ligament (ACL).,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
90,59_4,What is an injury for the ACL?,An ACL injury is a tear or sprain of the anterior cruciate ligament (ACL).,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
109,59_4,What is an injury for the ACL?,The anterior cruciate ligament (ACL) is a ligament in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,59_4,What is an injury for the ACL?,The anterior cruciate ligament (ACL) is a ligament in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,nice,false,false,,
16,59_4,What is an injury for the ACL?,"An ACL injury is a condition where the person with ACL is injured, especially in the early stages of the rehabilitation process, due to its high strength and ability to",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
21,59_4,What is an injury for the ACL?,"An ACL injury is a condition where the person with ACL is injured, especially in the early stages of the rehabilitation process, due to its high strength and ability to",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,malformed answer,
26,59_4,What is an injury for the ACL?,An anterior cruciate ligament (ACL) injury is a ligament injury in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
87,59_4,What is an injury for the ACL?,An anterior cruciate ligament (ACL) injury is a ligament injury in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,59_4,What is an injury for the ACL?,"The ACL is a cruciate ligament that attaches to the outside of the knee, and is the most commonly injured cruciate ligaments in sports.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
7,59_4,What is an injury for the ACL?,"The ACL is a cruciate ligament that attaches to the outside of the knee, and is the most commonly injured cruciate ligaments in sports.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,confusing answer,
17,59_4,What is an injury for the ACL?,An injury for it is a sprain or tear of the ligament of the ligament of the ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
52,59_4,What is an injury for the ACL?,An injury for it is a sprain or tear of the ligament of the ligament of the ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
21,59_4,What is an injury for the ACL?,ACL injuries occur in sporting context and range from partial tears to full ruptures.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
58,59_4,What is an injury for the ACL?,ACL injuries occur in sporting context and range from partial tears to full ruptures.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,59_4,What is an injury for the ACL?,An ACL is a ligament injury in the anterior cruciate ligament.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,59_4,What is an injury for the ACL?,An ACL is a ligament injury in the anterior cruciate ligament.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
5,59_4,What is an injury for the ACL?,The ACL is a ligament that connects the cruciate ligaments of the knee to the lateral collateral ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
38,59_4,What is an injury for the ACL?,The ACL is a ligament that connects the cruciate ligaments of the knee to the lateral collateral ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
16,59_4,What is an injury for the ACL?,An ACL injury is a rupture of the anterior cruciate ligament (ACL) in the anterior cruciate ligament (ACL) of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
13,59_4,What is an injury for the ACL?,An ACL injury is a rupture of the anterior cruciate ligament (ACL) in the anterior cruciate ligament (ACL) of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
24,59_4,What is an injury for the ACL?,An injury for it is a sprain or tear of the ligament of the ligament of the ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,true,false,,
16,59_4,What is an injury for the ACL?,An injury for it is a sprain or tear of the ligament of the ligament of the ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
8,59_4,What is an injury for the ACL?,An ACL injury is a rupture of the anterior cruciate ligament (ACL) in the anterior cruciate ligament (ACL) of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,59_4,What is an injury for the ACL?,An ACL injury is a rupture of the anterior cruciate ligament (ACL) in the anterior cruciate ligament (ACL) of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
18,59_4,What is an injury for the ACL?,"The ACL is a cruciate ligament that attaches to the outside of the knee, and is the most commonly injured cruciate ligaments in sports.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
103,59_4,What is an injury for the ACL?,"The ACL is a cruciate ligament that attaches to the outside of the knee, and is the most commonly injured cruciate ligaments in sports.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
50,59_4,What is an injury for the ACL?,The anterior cruciate ligament (ACL) is a ligament in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,"Though related, the response does not answer the question. Hence, selected ""No"".",false,true,,
35,59_4,What is an injury for the ACL?,The anterior cruciate ligament (ACL) is a ligament in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,It doesn't state what an injury for the ACL is.,false,true,,
17,59_4,What is an injury for the ACL?,An ACL injury is a tear or sprain of the anterior cruciate ligament (ACL).,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,59_4,What is an injury for the ACL?,An ACL injury is a tear or sprain of the anterior cruciate ligament (ACL).,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,59_4,What is an injury for the ACL?,An ACL is a ligament injury in the anterior cruciate ligament.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,59_4,What is an injury for the ACL?,An ACL is a ligament injury in the anterior cruciate ligament.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,59_4,What is an injury for the ACL?,"An ACL injury is a condition where the person with ACL is injured, especially in the early stages of the rehabilitation process, due to its high strength and ability to",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
4,59_4,What is an injury for the ACL?,"An ACL injury is a condition where the person with ACL is injured, especially in the early stages of the rehabilitation process, due to its high strength and ability to",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
18,59_4,What is an injury for the ACL?,ACL injuries occur in sporting context and range from partial tears to full ruptures.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
18,59_4,What is an injury for the ACL?,ACL injuries occur in sporting context and range from partial tears to full ruptures.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,59_4,What is an injury for the ACL?,An anterior cruciate ligament (ACL) injury is a ligament injury in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,59_4,What is an injury for the ACL?,An anterior cruciate ligament (ACL) injury is a ligament injury in the anterior cruciate ligament of the knee.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
36,59_4,What is an injury for the ACL?,The ACL is a ligament that connects the cruciate ligaments of the knee to the lateral collateral ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,,
5,59_4,What is an injury for the ACL?,The ACL is a ligament that connects the cruciate ligaments of the knee to the lateral collateral ligaments of the knee.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
41,59_7,What is arnica used for in sports injuries?,Arnica is used to treat sports-related injuries.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
22,59_7,What is arnica used for in sports injuries?,Arnica is used to treat sports-related injuries.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
12,59_7,What is arnica used for in sports injuries?,"Arnica is used in sports injuries such as torn ligaments, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendon",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
118,59_7,What is arnica used for in sports injuries?,"Arnica is used in sports injuries such as torn ligaments, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendon",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
31,59_7,What is arnica used for in sports injuries?,Arnica is commonly used to treat ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,true,false,,
11,59_7,What is arnica used for in sports injuries?,Arnica is commonly used to treat ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,positive one,false,false,random answer,
110,59_7,What is arnica used for in sports injuries?,"Arnica is widely used externally on bruises and other minor injuries, but despite this traditional use, there is no real scientific evidence that they work.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,59_7,What is arnica used for in sports injuries?,"Arnica is widely used externally on bruises and other minor injuries, but despite this traditional use, there is no real scientific evidence that they work.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,random answer,
9,59_7,What is arnica used for in sports injuries?,"Arnica is used for bruises, sprains, muscle soreness, and muscle spasms often associated with sports activity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,true,false,random answer,
10,59_7,What is arnica used for in sports injuries?,"Arnica is used for bruises, sprains, muscle soreness, and muscle spasms often associated with sports activity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,good one,false,false,,
19,59_7,What is arnica used for in sports injuries?,"Arnica is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,random answer,
23,59_7,What is arnica used for in sports injuries?,"Arnica is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,59_7,What is arnica used for in sports injuries?," Arnica is used for bruises, sprains, and strains.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,good one,false,false,,
6,59_7,What is arnica used for in sports injuries?," Arnica is used for bruises, sprains, and strains.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
26,59_7,What is arnica used for in sports injuries?,"Arnica Montana is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
82,59_7,What is arnica used for in sports injuries?,"Arnica Montana is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
84,59_7,What is arnica used for in sports injuries?,Arnica is used for the treatment of ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
17,59_7,What is arnica used for in sports injuries?,Arnica is used for the treatment of ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
26,59_7,What is arnica used for in sports injuries?,Arnica is used for the anterior cruciate ligament (ACL) injury.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
29,59_7,What is arnica used for in sports injuries?,Arnica is used for the anterior cruciate ligament (ACL) injury.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
19,59_7,What is arnica used for in sports injuries?,"Arnica Montana is used to treat minor sports injuries, including muscular pain, stiffness and aches.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,59_7,What is arnica used for in sports injuries?,"Arnica Montana is used to treat minor sports injuries, including muscular pain, stiffness and aches.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,true,false,random answer,
15,59_7,What is arnica used for in sports injuries?,Arnica is used to treat sports-related injuries.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
10,59_7,What is arnica used for in sports injuries?,Arnica is used to treat sports-related injuries.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
33,59_7,What is arnica used for in sports injuries?,"Arnica Montana is used to treat minor sports injuries, including muscular pain, stiffness and aches.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
5,59_7,What is arnica used for in sports injuries?,"Arnica Montana is used to treat minor sports injuries, including muscular pain, stiffness and aches.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,59_7,What is arnica used for in sports injuries?,"Arnica is used for bruises, sprains, muscle soreness, and muscle spasms often associated with sports activity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
5,59_7,What is arnica used for in sports injuries?,"Arnica is used for bruises, sprains, muscle soreness, and muscle spasms often associated with sports activity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,59_7,What is arnica used for in sports injuries?,Arnica is used for the anterior cruciate ligament (ACL) injury.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,59_7,What is arnica used for in sports injuries?,Arnica is used for the anterior cruciate ligament (ACL) injury.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
19,59_7,What is arnica used for in sports injuries?,Arnica is commonly used to treat ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
53,59_7,What is arnica used for in sports injuries?,Arnica is commonly used to treat ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,59_7,What is arnica used for in sports injuries?,Arnica is used for the treatment of ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
15,59_7,What is arnica used for in sports injuries?,Arnica is used for the treatment of ACL injuries.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,GOOD,false,false,,
17,59_7,What is arnica used for in sports injuries?,"Arnica Montana is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,59_7,What is arnica used for in sports injuries?,"Arnica Montana is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
71,59_7,What is arnica used for in sports injuries?,"Arnica is used in sports injuries such as torn ligaments, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendon",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,59_7,What is arnica used for in sports injuries?,"Arnica is used in sports injuries such as torn ligaments, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendonitis, tendon",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
56,59_7,What is arnica used for in sports injuries?," Arnica is used for bruises, sprains, and strains.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,59_7,What is arnica used for in sports injuries?," Arnica is used for bruises, sprains, and strains.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,59_7,What is arnica used for in sports injuries?,"Arnica is widely used externally on bruises and other minor injuries, but despite this traditional use, there is no real scientific evidence that they work.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
21,59_7,What is arnica used for in sports injuries?,"Arnica is widely used externally on bruises and other minor injuries, but despite this traditional use, there is no real scientific evidence that they work.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,NICE,false,false,,
14,59_7,What is arnica used for in sports injuries?,"Arnica is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,59_7,What is arnica used for in sports injuries?,"Arnica is a traditional herbal medicinal, providing natural care for minor sports injuries, including relief of muscular pain, stiffness and sprains.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,NICE,false,false,,
26,591_4,did Pinhead have genital piercings?,Pinhead was originally intended to have a navel piercing implying that the character had genital piercings.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,591_4,did Pinhead have genital piercings?,Pinhead was originally intended to have a navel piercing implying that the character had genital piercings.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
28,591_4,did Pinhead have genital piercings?,"[6] Initially, Barker intended Pinhead to have a navel piercing implying that the character had genital piercings .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
18,591_4,did Pinhead have genital piercings?,"[6] Initially, Barker intended Pinhead to have a navel piercing implying that the character had genital piercings .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
34,591_4,did Pinhead have genital piercings?,barker intended pinhead to have a navel piercing implying that the character had genital piercings,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
38,591_4,did Pinhead have genital piercings?,barker intended pinhead to have a navel piercing implying that the character had genital piercings,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,It only answers that it was implied.,false,true,,
12,591_4,did Pinhead have genital piercings?,Pinhead's genital piercings were initially intended to have a navel piercing implying that the character had genital piercings.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,591_4,did Pinhead have genital piercings?,Pinhead's genital piercings were initially intended to have a navel piercing implying that the character had genital piercings.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,594_2,What is Ohio Valley Wrestling?,"Ohio Valley Wrestling is an American independent professional wrestling promotion based in Louisville, Kentucky.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
26,594_2,What is Ohio Valley Wrestling?,"Ohio Valley Wrestling is an American independent professional wrestling promotion based in Louisville, Kentucky.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,594_2,What is Ohio Valley Wrestling?,"Ohio Valley Wrestling (OVW) is a professional wrestling association based in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,594_2,What is Ohio Valley Wrestling?,"Ohio Valley Wrestling (OVW) is a professional wrestling association based in Des Moines, Iowa.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,594_2,What is Ohio Valley Wrestling?,Ohio Valley Wrestling (OVW) is a professional wrestling promotion in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
5,594_2,What is Ohio Valley Wrestling?,Ohio Valley Wrestling (OVW) is a professional wrestling promotion in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
15,594_2,What is Ohio Valley Wrestling?,"Ohio Valley Wrestling - Wikipedia CentralNotice Ohio Valley Wrestling From Wikipedia, the free encyclopedia Jump to navigation Jump to search American professional wrestling promotion Ohio Valley Wrestling Acronym OVW Founded 1993 Style Sports entertainment Professional wrestling Headquarters Louisville, Kentucky Founder(s) Nightmare Danny Davis Owner(s) Al Snow Formerly NWA Ohio Valley Championship Wrestling (1993–1997) Website www .ovwrestling .com Ohio Valley Wrestling (OVW) is an American independent professional wrestling promotion based in Louisville, Kentucky .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
73,594_2,What is Ohio Valley Wrestling?,"Ohio Valley Wrestling - Wikipedia CentralNotice Ohio Valley Wrestling From Wikipedia, the free encyclopedia Jump to navigation Jump to search American professional wrestling promotion Ohio Valley Wrestling Acronym OVW Founded 1993 Style Sports entertainment Professional wrestling Headquarters Louisville, Kentucky Founder(s) Nightmare Danny Davis Owner(s) Al Snow Formerly NWA Ohio Valley Championship Wrestling (1993–1997) Website www .ovwrestling .com Ohio Valley Wrestling (OVW) is an American independent professional wrestling promotion based in Louisville, Kentucky .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
14,594_2,What is Ohio Valley Wrestling?," Ohio Valley Wrestling is a professional wrestling promotion based in Louisville, Kentucky.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,594_2,What is Ohio Valley Wrestling?," Ohio Valley Wrestling is a professional wrestling promotion based in Louisville, Kentucky.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,594_3,Was John Cena successful in the OVW?,John Cena held the OVW Heavyweight Championship for two months and the OVW Southern Tag Team Championship for two months.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,594_3,Was John Cena successful in the OVW?,John Cena held the OVW Heavyweight Championship for two months and the OVW Southern Tag Team Championship for two months.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,594_3,Was John Cena successful in the OVW?,"During his time there, Cena wrestled under the ring name The Prototype and held the OVW Heavyweight Championship for three months.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,594_3,Was John Cena successful in the OVW?,"During his time there, Cena wrestled under the ring name The Prototype and held the OVW Heavyweight Championship for three months.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
5,594_3,Was John Cena successful in the OVW?,"Throughout his time there, John Cena wrestled under the ring name The Prototype and held the OVW Southern Tag Team Championship for three months.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,594_3,Was John Cena successful in the OVW?,"Throughout his time there, John Cena wrestled under the ring name The Prototype and held the OVW Southern Tag Team Championship for three months.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
14,6_3,What did the Marbury vs Madison case establish?,The U.S. Supreme Court case Marbury v. Madison established the principle of judicial review.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,6_3,What did the Marbury vs Madison case establish?,The U.S. Supreme Court case Marbury v. Madison established the principle of judicial review.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,6_3,What did the Marbury vs Madison case establish?,Marbury v. Madison (1803) established the principle of judicial review—the power of the federal courts to declare legislative and executive acts unconstitutional.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
32,6_3,What did the Marbury vs Madison case establish?,Marbury v. Madison (1803) established the principle of judicial review—the power of the federal courts to declare legislative and executive acts unconstitutional.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
46,6_3,What did the Marbury vs Madison case establish?,Marbury v. Madison was the first case decided by the Supreme Court of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,random answer,
40,6_3,What did the Marbury vs Madison case establish?,Marbury v. Madison was the first case decided by the Supreme Court of the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,correct answer,
13,6_3,What did the Marbury vs Madison case establish?,Marbury vs Madison established that the Supreme Court has the power to decide cases.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
7,6_3,What did the Marbury vs Madison case establish?,Marbury vs Madison established that the Supreme Court has the power to decide cases.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
56,6_3,What did the Marbury vs Madison case establish?,"[ 77 ] marbury v. madison was the first case in which the supreme court struck down a federal law as unconstitutional and it is most significant for its role in establishing the supreme court's power of judicial review,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
49,6_3,What did the Marbury vs Madison case establish?,"[ 77 ] marbury v. madison was the first case in which the supreme court struck down a federal law as unconstitutional and it is most significant for its role in establishing the supreme court's power of judicial review,",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
31,6_3,What did the Marbury vs Madison case establish?,"The Marbury vs Madison case established the Supreme Court's power of judicial review, or the power to invalidate laws as unconstitutional.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
37,6_3,What did the Marbury vs Madison case establish?,"The Marbury vs Madison case established the Supreme Court's power of judicial review, or the power to invalidate laws as unconstitutional.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
94,6_5,What was the implication of Roe vs Wade?,"Roe rendered these laws unconstitutional, making abortion services vastly safer and more accessible to women throughout the country. The decision also set a",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
7,6_5,What was the implication of Roe vs Wade?,"Roe rendered these laws unconstitutional, making abortion services vastly safer and more accessible to women throughout the country. The decision also set a",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
28,6_5,What was the implication of Roe vs Wade?,Roe v Wade was a 1973 Supreme Court decision that legalized abortion in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
48,6_5,What was the implication of Roe vs Wade?,Roe v Wade was a 1973 Supreme Court decision that legalized abortion in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
17,6_5,What was the implication of Roe vs Wade?,"The Supreme Court's landmark decision in Roe v. Wade held that abortions can be outlawed in certain circumstances, except in cases of rape, incest, and when the mother's life is in danger.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,NA,false,true,confusing answer,
63,6_5,What was the implication of Roe vs Wade?,"The Supreme Court's landmark decision in Roe v. Wade held that abortions can be outlawed in certain circumstances, except in cases of rape, incest, and when the mother's life is in danger.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,confusing answer,
33,6_7,What was the point of Brown v Board of Ed?,"In Brown v Board of Education, the United States Supreme Court ruled that public schools must be racially integrated.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
25,6_7,What was the point of Brown v Board of Ed?,"In Brown v Board of Education, the United States Supreme Court ruled that public schools must be racially integrated.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
14,6_7,What was the point of Brown v Board of Ed?,"In 1954, the U.S. Supreme Court decided the case Brown v. Board of Education.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,correct answer,
15,6_7,What was the point of Brown v Board of Ed?,"In 1954, the U.S. Supreme Court decided the case Brown v. Board of Education.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,random answer,
19,6_7,What was the point of Brown v Board of Ed?,"Brown v. Board of Education of Topeka, 347 U.S. 483 (1954), was a landmark decision of the U",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
49,6_7,What was the point of Brown v Board of Ed?,"Brown v. Board of Education of Topeka, 347 U.S. 483 (1954), was a landmark decision of the U",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
18,6_7,What was the point of Brown v Board of Ed?,Brown v Board of Education was a 1954 United States Supreme Court case in which the Court ruled that the public education system was unconstitutional.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,6_7,What was the point of Brown v Board of Ed?,Brown v Board of Education was a 1954 United States Supreme Court case in which the Court ruled that the public education system was unconstitutional.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,6_7,What was the point of Brown v Board of Ed?,Brown v Board of Education was a 1954 United States Supreme Court case.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,random answer,
24,6_7,What was the point of Brown v Board of Ed?,Brown v Board of Education was a 1954 United States Supreme Court case.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,correct answer,
11,60_1,Tell me about the benefits of yoga.,"On a physical level, yoga helps improve flexibility, strength, balance, and endurance.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
88,60_1,Tell me about the benefits of yoga.,"On a physical level, yoga helps improve flexibility, strength, balance, and endurance.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,60_1,Tell me about the benefits of yoga.,"The benefits of yoga for you include a lower risk of heart disease, a lower risk of stroke, a lower risk of cancer, and a lower risk of type 2 diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
89,60_1,Tell me about the benefits of yoga.,"The benefits of yoga for you include a lower risk of heart disease, a lower risk of stroke, a lower risk of cancer, and a lower risk of type 2 diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
67,60_1,Tell me about the benefits of yoga.,"Yoga improves your posture, reduces stress, lowers your blood pressure and reduces your risk of heart disease and diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,60_1,Tell me about the benefits of yoga.,"Yoga improves your posture, reduces stress, lowers your blood pressure and reduces your risk of heart disease and diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,60_1,Tell me about the benefits of yoga.,"The benefits of yoga include a decrease in blood pressure, a decrease in the risk of heart disease, and a reduction in the risk of cancer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,positive one,false,false,,
111,60_1,Tell me about the benefits of yoga.,"The benefits of yoga include a decrease in blood pressure, a decrease in the risk of heart disease, and a reduction in the risk of cancer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,60_1,Tell me about the benefits of yoga.,Yoga is known for its many health benefits.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,correct answer,
12,60_1,Tell me about the benefits of yoga.,Yoga is known for its many health benefits.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,positive one,false,false,random answer,
12,60_1,Tell me about the benefits of yoga.,"Yoga has been shown to have many health benefits, including weight loss, stress reduction, sleep apnea, and many more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
90,60_1,Tell me about the benefits of yoga.,"Yoga has been shown to have many health benefits, including weight loss, stress reduction, sleep apnea, and many more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
13,60_1,Tell me about the benefits of yoga.,"Yoga is known for its many health benefits, including weight-loss, stress-relief, and relaxation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
75,60_1,Tell me about the benefits of yoga.,"Yoga is known for its many health benefits, including weight-loss, stress-relief, and relaxation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,60_1,Tell me about the benefits of yoga.,"The benefits of yoga for you include a lower risk of heart disease, a lower risk of stroke, a lower risk of cancer, and a lower risk of type 2 diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,60_1,Tell me about the benefits of yoga.,"The benefits of yoga for you include a lower risk of heart disease, a lower risk of stroke, a lower risk of cancer, and a lower risk of type 2 diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,60_1,Tell me about the benefits of yoga.,"On a physical level, yoga helps improve flexibility, strength, balance, and endurance.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,60_1,Tell me about the benefits of yoga.,"On a physical level, yoga helps improve flexibility, strength, balance, and endurance.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,60_1,Tell me about the benefits of yoga.,"The benefits of yoga include a decrease in blood pressure, a decrease in the risk of heart disease, and a reduction in the risk of cancer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
19,60_1,Tell me about the benefits of yoga.,"The benefits of yoga include a decrease in blood pressure, a decrease in the risk of heart disease, and a reduction in the risk of cancer.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,60_1,Tell me about the benefits of yoga.,"Yoga is known for its many health benefits, including weight-loss, stress-relief, and relaxation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,60_1,Tell me about the benefits of yoga.,"Yoga is known for its many health benefits, including weight-loss, stress-relief, and relaxation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
26,60_1,Tell me about the benefits of yoga.,"Yoga improves your posture, reduces stress, lowers your blood pressure and reduces your risk of heart disease and diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,60_1,Tell me about the benefits of yoga.,"Yoga improves your posture, reduces stress, lowers your blood pressure and reduces your risk of heart disease and diabetes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,NICE,false,false,,
11,60_1,Tell me about the benefits of yoga.,"Yoga has been shown to have many health benefits, including weight loss, stress reduction, sleep apnea, and many more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,60_1,Tell me about the benefits of yoga.,"Yoga has been shown to have many health benefits, including weight loss, stress reduction, sleep apnea, and many more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
21,60_1,Tell me about the benefits of yoga.,Yoga is known for its many health benefits.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
4,60_1,Tell me about the benefits of yoga.,Yoga is known for its many health benefits.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
12,60_2,Does yoga help in reducing stress?,The practice of yoga is well demonstrated to reduce the physical effects of stress.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,60_2,Does yoga help in reducing stress?,The practice of yoga is well demonstrated to reduce the physical effects of stress.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,60_2,Does yoga help in reducing stress?,"The practice of yoga does not only relieve stress effectively, but it also releases tension.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,right answer,false,false,,
9,60_2,Does yoga help in reducing stress?,"The practice of yoga does not only relieve stress effectively, but it also releases tension.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,random answer,
16,60_2,Does yoga help in reducing stress?,Yoga can help you get a better balance between exercise and relaxation. Exercise can help you get a better workout without overloading,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
102,60_2,Does yoga help in reducing stress?,Yoga can help you get a better balance between exercise and relaxation. Exercise can help you get a better workout without overloading,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
21,60_2,Does yoga help in reducing stress?,Yoga helps in reducing stress.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,true,false,random answer,
26,60_2,Does yoga help in reducing stress?,Yoga helps in reducing stress.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
28,60_2,Does yoga help in reducing stress?,Yoga is a form of stress management.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,confusing answer,
9,60_2,Does yoga help in reducing stress?,Yoga is a form of stress management.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,confusing answer,
20,60_2,Does yoga help in reducing stress?,Yoga is a form of stress management.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
44,60_2,Does yoga help in reducing stress?,Yoga is a form of stress management.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,"I'm on the fence with this answer. It does answer the question, however.",false,false,,
30,60_2,Does yoga help in reducing stress?,Yoga can help you get a better balance between exercise and relaxation. Exercise can help you get a better workout without overloading,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
11,60_2,Does yoga help in reducing stress?,Yoga can help you get a better balance between exercise and relaxation. Exercise can help you get a better workout without overloading,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
53,60_2,Does yoga help in reducing stress?,The practice of yoga is well demonstrated to reduce the physical effects of stress.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,60_2,Does yoga help in reducing stress?,The practice of yoga is well demonstrated to reduce the physical effects of stress.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,NICE,false,false,,
5,60_2,Does yoga help in reducing stress?,Yoga helps in reducing stress.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
19,60_2,Does yoga help in reducing stress?,Yoga helps in reducing stress.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,GOOD,false,false,,
25,60_2,Does yoga help in reducing stress?,"The practice of yoga does not only relieve stress effectively, but it also releases tension.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,60_2,Does yoga help in reducing stress?,"The practice of yoga does not only relieve stress effectively, but it also releases tension.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to reduce asthma symptoms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
24,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to reduce asthma symptoms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to relieve asthma.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,positive one,false,false,,
11,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to relieve asthma.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,random answer,
82,60_7,Does mindful breathing help relieve asthma?,Many and practitioners believe that yoga can relieve symptoms of asthma through a retrain of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
98,60_7,Does mindful breathing help relieve asthma?,Many and practitioners believe that yoga can relieve symptoms of asthma through a retrain of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
28,60_7,Does mindful breathing help relieve asthma?,Attentive breathing helps relieve asthma. It's a good idea to stop smoking and relax.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
7,60_7,Does mindful breathing help relieve asthma?,Attentive breathing helps relieve asthma. It's a good idea to stop smoking and relax.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
14,60_7,Does mindful breathing help relieve asthma?,These effective asanas and remedies can help you ease your asthma.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
114,60_7,Does mindful breathing help relieve asthma?,These effective asanas and remedies can help you ease your asthma.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,60_7,Does mindful breathing help relieve asthma?,yes. mindful breathing helps relieve asthma,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
24,60_7,Does mindful breathing help relieve asthma?,yes. mindful breathing helps relieve asthma,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
91,60_7,Does mindful breathing help relieve asthma?,Many researchers and practitioners believe that yoga can relieve symptoms of asthma through a retraining of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
48,60_7,Does mindful breathing help relieve asthma?,Many researchers and practitioners believe that yoga can relieve symptoms of asthma through a retraining of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
74,60_7,Does mindful breathing help relieve asthma?,yes. mindful breathing helps relieve asthma,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
8,60_7,Does mindful breathing help relieve asthma?,yes. mindful breathing helps relieve asthma,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
11,60_7,Does mindful breathing help relieve asthma?,Attentive breathing helps relieve asthma. It's a good idea to stop smoking and relax.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
24,60_7,Does mindful breathing help relieve asthma?,Attentive breathing helps relieve asthma. It's a good idea to stop smoking and relax.,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
15,60_7,Does mindful breathing help relieve asthma?,Many researchers and practitioners believe that yoga can relieve symptoms of asthma through a retraining of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,60_7,Does mindful breathing help relieve asthma?,Many researchers and practitioners believe that yoga can relieve symptoms of asthma through a retraining of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
27,60_7,Does mindful breathing help relieve asthma?,These effective asanas and remedies can help you ease your asthma.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
32,60_7,Does mindful breathing help relieve asthma?,These effective asanas and remedies can help you ease your asthma.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,The answer doesn't include anything referring to mindful breathing.,false,true,,
9,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to reduce asthma symptoms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
26,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to reduce asthma symptoms.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to relieve asthma.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,60_7,Does mindful breathing help relieve asthma?,Mindful breathing has been shown to relieve asthma.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
34,60_7,Does mindful breathing help relieve asthma?,Many and practitioners believe that yoga can relieve symptoms of asthma through a retrain of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
34,60_7,Does mindful breathing help relieve asthma?,Many and practitioners believe that yoga can relieve symptoms of asthma through a retrain of disturbed breathing patterns.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,61_1,Who are The Avengers?,The Avengers are a fictional team of superheroes appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
48,61_1,Who are The Avengers?,The Avengers are a fictional team of superheroes appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,61_1,Who are The Avengers?,The Avengers is an American comic book superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,61_1,Who are The Avengers?,The Avengers is an American comic book superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
29,61_1,Who are The Avengers?,The Avengers are a fictional group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
35,61_1,Who are The Avengers?,The Avengers are a fictional group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,positive one,false,false,,
11,61_1,Who are The Avengers?,The Avengers is a fictional superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,good one,false,false,,
8,61_1,Who are The Avengers?,The Avengers is a fictional superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,61_1,Who are The Avengers?," The Avengers are a team of superheroes that includes Iron Man, Captain America, Thor, Hulk, Black Widow, Hawkeye, and Nick Fury.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,61_1,Who are The Avengers?," The Avengers are a team of superheroes that includes Iron Man, Captain America, Thor, Hulk, Black Widow, Hawkeye, and Nick Fury.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,61_1,Who are The Avengers?,The Avengers are a fictional superhero team created by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,right answer,false,false,,
74,61_1,Who are The Avengers?,The Avengers are a fictional superhero team created by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,61_1,Who are The Avengers?,The Avengers are a group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,61_1,Who are The Avengers?,The Avengers are a group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
15,61_1,Who are The Avengers?," The Avengers are a team of superheroes that includes Iron Man, Captain America, Thor, Hulk, Black Widow, Hawkeye, and Nick Fury.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,61_1,Who are The Avengers?," The Avengers are a team of superheroes that includes Iron Man, Captain America, Thor, Hulk, Black Widow, Hawkeye, and Nick Fury.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
18,61_1,Who are The Avengers?,The Avengers are a fictional team of superheroes appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,61_1,Who are The Avengers?,The Avengers are a fictional team of superheroes appearing in American comic books published by Marvel Comics.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,61_1,Who are The Avengers?,The Avengers are a fictional group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,61_1,Who are The Avengers?,The Avengers are a fictional group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,61_1,Who are The Avengers?,The Avengers is a fictional superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,61_1,Who are The Avengers?,The Avengers is a fictional superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,61_1,Who are The Avengers?,The Avengers are a group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
18,61_1,Who are The Avengers?,The Avengers are a group of superheros from the Marvel Comics Universe.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,61_1,Who are The Avengers?,The Avengers are a fictional superhero team created by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,61_1,Who are The Avengers?,The Avengers are a fictional superhero team created by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
13,61_1,Who are The Avengers?,The Avengers is an American comic book superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
3,61_1,Who are The Avengers?,The Avengers is an American comic book superhero team appearing in American comic books published by Marvel Comics.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
69,61_8,Who are the important members of the Justice League?,"Originally consisting of Superman, Batman, Wonder Woman, The Flash, Barry Allen, Green Lantern/Hal Jordan, Aquaman and the Martian Manhunter, they first appeared together as the Justice League of America in The Brave and the Bold #28",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
97,61_8,Who are the important members of the Justice League?,"Originally consisting of Superman, Batman, Wonder Woman, The Flash, Barry Allen, Green Lantern/Hal Jordan, Aquaman and the Martian Manhunter, they first appeared together as the Justice League of America in The Brave and the Bold #28",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,61_8,Who are the important members of the Justice League?,"The members of the Justice League are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,61_8,Who are the important members of the Justice League?,"The members of the Justice League are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
59,61_8,Who are the important members of the Justice League?,"Members of the Justice League include Superman, Batman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,61_8,Who are the important members of the Justice League?,"Members of the Justice League include Superman, Batman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
46,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,positive one,false,false,,
19,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
86,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, Flash, Green Lantern, and the Justice Supreme.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
31,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, Flash, Green Lantern, and the Justice Supreme.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
89,61_8,Who are the important members of the Justice League?,"The Justice League members are Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,confusing answer,
83,61_8,Who are the important members of the Justice League?,"The Justice League members are Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,confusing answer,
12,61_8,Who are the important members of the Justice League?," The Justice League includes Superman, Batman, Wonder Woman, Green Lantern, The Flash, Aquaman, Martian Manhunter, and the Martian Manhunter.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,good one,false,false,,
62,61_8,Who are the important members of the Justice League?," The Justice League includes Superman, Batman, Wonder Woman, Green Lantern, The Flash, Aquaman, Martian Manhunter, and the Martian Manhunter.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
96,61_8,Who are the important members of the Justice League?,"The members of the Justice League of America are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
8,61_8,Who are the important members of the Justice League?,"The members of the Justice League of America are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
91,61_8,Who are the important members of the Justice League?,"The Justice League consists of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
13,61_8,Who are the important members of the Justice League?,"The Justice League consists of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,positive one,false,false,,
10,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, Flash, Green Lantern, and the Justice Supreme.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, Flash, Green Lantern, and the Justice Supreme.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,61_8,Who are the important members of the Justice League?," The Justice League includes Superman, Batman, Wonder Woman, Green Lantern, The Flash, Aquaman, Martian Manhunter, and the Martian Manhunter.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,61_8,Who are the important members of the Justice League?," The Justice League includes Superman, Batman, Wonder Woman, Green Lantern, The Flash, Aquaman, Martian Manhunter, and the Martian Manhunter.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
22,61_8,Who are the important members of the Justice League?,"Originally consisting of Superman, Batman, Wonder Woman, The Flash, Barry Allen, Green Lantern/Hal Jordan, Aquaman and the Martian Manhunter, they first appeared together as the Justice League of America in The Brave and the Bold #28",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,61_8,Who are the important members of the Justice League?,"Originally consisting of Superman, Batman, Wonder Woman, The Flash, Barry Allen, Green Lantern/Hal Jordan, Aquaman and the Martian Manhunter, they first appeared together as the Justice League of America in The Brave and the Bold #28",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,61_8,Who are the important members of the Justice League?,"The Justice League consists of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,61_8,Who are the important members of the Justice League?,"The Justice League consists of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,61_8,Who are the important members of the Justice League?,"The members of the Justice League are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,61_8,Who are the important members of the Justice League?,"The members of the Justice League are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,61_8,Who are the important members of the Justice League?,"The Justice League members are Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
3,61_8,Who are the important members of the Justice League?,"The Justice League members are Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
15,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
3,61_8,Who are the important members of the Justice League?,"The Justice League is made up of Batman, Superman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
14,61_8,Who are the important members of the Justice League?,"Members of the Justice League include Superman, Batman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,61_8,Who are the important members of the Justice League?,"Members of the Justice League include Superman, Batman, Wonder Woman, Aquaman, and The Flash.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,61_8,Who are the important members of the Justice League?,"The members of the Justice League of America are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
30,61_8,Who are the important members of the Justice League?,"The members of the Justice League of America are Batman, Superman, Wonder Woman, Aquaman, Flash, Supergirl, and Green Lantern.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,62_1,What is the Surrealism movement in art?,"Surrealism is a cultural movement that began in the early 1920s, and is best known for its visual artworks and writings.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,true,false,random answer,
12,62_1,What is the Surrealism movement in art?,"Surrealism is a cultural movement that began in the early 1920s, and is best known for its visual artworks and writings.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
100,62_1,What is the Surrealism movement in art?,"Surrealism is a movement in visual art and literature, flourishing in Europe between World War I and World War II.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,62_1,What is the Surrealism movement in art?,"Surrealism is a movement in visual art and literature, flourishing in Europe between World War I and World War II.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,positive one,false,false,,
110,62_1,What is the Surrealism movement in art?,The Surrealism movement in art is a reaction against what its members saw as the wrought destruction by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,62_1,What is the Surrealism movement in art?,The Surrealism movement in art is a reaction against what its members saw as the wrought destruction by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,good one,false,false,,
78,62_1,What is the Surrealism movement in art?,Surrealism is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
30,62_1,What is the Surrealism movement in art?,Surrealism is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
40,62_1,What is the Surrealism movement in art?,The Surrealism movement is an artistic movement that emerged in the late 1920s and early 1930s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
24,62_1,What is the Surrealism movement in art?,The Surrealism movement is an artistic movement that emerged in the late 1920s and early 1930s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
100,62_1,What is the Surrealism movement in art?,The Surrealist movement in art is a reaction against what its members saw as the destruction wrought by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
11,62_1,What is the Surrealism movement in art?,The Surrealist movement in art is a reaction against what its members saw as the destruction wrought by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,nice,false,false,,
21,62_1,What is the Surrealism movement in art?,Surrealism is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,62_1,What is the Surrealism movement in art?,Surrealism is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
63,62_1,What is the Surrealism movement in art?,"Surrealism is a movement in visual art and literature, flourishing in Europe between World War I and World War II.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,"Though related, the response does not answer the question. Hence selected ""No."".",false,true,,
9,62_1,What is the Surrealism movement in art?,"Surrealism is a movement in visual art and literature, flourishing in Europe between World War I and World War II.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,62_1,What is the Surrealism movement in art?,The Surrealist movement in art is a reaction against what its members saw as the destruction wrought by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
3,62_1,What is the Surrealism movement in art?,The Surrealist movement in art is a reaction against what its members saw as the destruction wrought by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
15,62_1,What is the Surrealism movement in art?,The Surrealism movement in art is a reaction against what its members saw as the wrought destruction by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
3,62_1,What is the Surrealism movement in art?,The Surrealism movement in art is a reaction against what its members saw as the wrought destruction by the rationalism that had guided European culture and politics in the past and that had culminated in the horrors of World War I.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
58,62_1,What is the Surrealism movement in art?,The Surrealism movement is an artistic movement that emerged in the late 1920s and early 1930s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,"Though related, the response does not clearly answer the question. So, I've selected ""No.""",false,true,,
11,62_1,What is the Surrealism movement in art?,The Surrealism movement is an artistic movement that emerged in the late 1920s and early 1930s.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
42,62_1,What is the Surrealism movement in art?,"Surrealism is a cultural movement that began in the early 1920s, and is best known for its visual artworks and writings.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,62_1,What is the Surrealism movement in art?,"Surrealism is a cultural movement that began in the early 1920s, and is best known for its visual artworks and writings.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
28,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still being used today. It is believed that the term ""surrealism"" is still valid for many years, but it is still",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
98,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still being used today. It is believed that the term ""surrealism"" is still valid for many years, but it is still",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
78,62_10,Is the Surrealism movement in art still used today?,"Today, surrealism is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,62_10,Is the Surrealism movement in art still used today?,"Today, surrealism is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
102,62_10,Is the Surrealism movement in art still used today?,Surrealism is still used today because it is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,62_10,Is the Surrealism movement in art still used today?,Surrealism is still used today because it is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,62_10,Is the Surrealism movement in art still used today?,surrealism is still alive and growing until today,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
87,62_10,Is the Surrealism movement in art still used today?,surrealism is still alive and growing until today,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
13,62_10,Is the Surrealism movement in art still used today?,The term surrealism is still used today.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
62,62_10,Is the Surrealism movement in art still used today?,The term surrealism is still used today.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
8,62_10,Is the Surrealism movement in art still used today?,the surrealism movement is still alive and growing until today.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
108,62_10,Is the Surrealism movement in art still used today?,the surrealism movement is still alive and growing until today.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
73,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still alive and growing until today. Many artists around the world are influenced by Surrealism styles, ideas & techniques. Today, is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still alive and growing until today. Many artists around the world are influenced by Surrealism styles, ideas & techniques. Today, is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
13,62_10,Is the Surrealism movement in art still used today?,the surrealism movement is still alive and growing until today.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
4,62_10,Is the Surrealism movement in art still used today?,the surrealism movement is still alive and growing until today.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
20,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still alive and growing until today. Many artists around the world are influenced by Surrealism styles, ideas & techniques. Today, is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still alive and growing until today. Many artists around the world are influenced by Surrealism styles, ideas & techniques. Today, is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,62_10,Is the Surrealism movement in art still used today?,"Today, surrealism is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
4,62_10,Is the Surrealism movement in art still used today?,"Today, surrealism is a familiar form of art that continues to grow globally.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
17,62_10,Is the Surrealism movement in art still used today?,surrealism is still alive and growing until today,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
3,62_10,Is the Surrealism movement in art still used today?,surrealism is still alive and growing until today,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
17,62_10,Is the Surrealism movement in art still used today?,Surrealism is still used today because it is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,62_10,Is the Surrealism movement in art still used today?,Surrealism is still used today because it is a movement in art that uses the subconscious mind to create art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
16,62_10,Is the Surrealism movement in art still used today?,The term surrealism is still used today.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,62_10,Is the Surrealism movement in art still used today?,The term surrealism is still used today.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
31,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still being used today. It is believed that the term ""surrealism"" is still valid for many years, but it is still",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
5,62_10,Is the Surrealism movement in art still used today?,"Surrealism is still being used today. It is believed that the term ""surrealism"" is still valid for many years, but it is still",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
10,62_8,Why did Dali choose surrealism?,"Salvador Dal, was known for his wild art and a public personality to match, and these two elements helped him rise above the rest of the surrealists.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
113,62_8,Why did Dali choose surrealism?,"Salvador Dal, was known for his wild art and a public personality to match, and these two elements helped him rise above the rest of the surrealists.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,confusing answer,
6,62_8,Why did Dali choose surrealism?,Salvador Dalí chose surrealism because he believed that surrealism was the most important movement in art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
34,62_8,Why did Dali choose surrealism?,Salvador Dalí chose surrealism because he believed that surrealism was the most important movement in art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
27,62_8,Why did Dali choose surrealism?,Salvador Dalí was inspired by surrealism.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,confusing answer,
32,62_8,Why did Dali choose surrealism?,Salvador Dalí was inspired by surrealism.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,confusing answer,
90,62_8,Why did Dali choose surrealism?,Salvador Dalí chose surrealism because he believed that surrealism was the most important movement in art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,62_8,Why did Dali choose surrealism?,Salvador Dalí chose surrealism because he believed that surrealism was the most important movement in art.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
34,62_8,Why did Dali choose surrealism?,Salvador Dalí was inspired by surrealism.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
19,62_8,Why did Dali choose surrealism?,Salvador Dalí was inspired by surrealism.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,It doesn't answer why he chose it.,false,true,,
4,62_8,Why did Dali choose surrealism?,"Salvador Dal, was known for his wild art and a public personality to match, and these two elements helped him rise above the rest of the surrealists.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
23,62_8,Why did Dali choose surrealism?,"Salvador Dal, was known for his wild art and a public personality to match, and these two elements helped him rise above the rest of the surrealists.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,It doesn't answer why he chose surrealism.,false,true,,
9,63_3,How does blockchain work?,"At the core of blockchain is the idea of the traditional ledger, recording transactions; whether of money goods or secure data.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
10,63_3,How does blockchain work?,"At the core of blockchain is the idea of the traditional ledger, recording transactions; whether of money goods or secure data.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
13,63_3,How does blockchain work?,"Blockchain is a distributed, computerized, distributed ledger.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,63_3,How does blockchain work?,"Blockchain is a distributed, computerized, distributed ledger.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,good one,false,false,,
25,63_3,How does blockchain work?,"The blockchain is a distributed ledger technology that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
9,63_3,How does blockchain work?,"The blockchain is a distributed ledger technology that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,confusing answer,
21,63_3,How does blockchain work?,"The blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,good one,false,false,confusing answer,
69,63_3,How does blockchain work?,"The blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,confusing answer,
12,63_3,How does blockchain work?,A blockchain is a digital record that is stored in a data structure and can be used to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
26,63_3,How does blockchain work?,A blockchain is a digital record that is stored in a data structure and can be used to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,63_3,How does blockchain work?,"A blockchain is a data storage system that uses blockchain technology to store, retrieve, and distribute information.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
55,63_3,How does blockchain work?,"A blockchain is a data storage system that uses blockchain technology to store, retrieve, and distribute information.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
15,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information from multiple sources.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
14,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information from multiple sources.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
95,63_3,How does blockchain work?,Blockchain is an open-source distributed ledger technology.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,confusing answer,
6,63_3,How does blockchain work?,Blockchain is an open-source distributed ledger technology.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,confusing answer,
17,63_3,How does blockchain work?,how does blockchain technology work,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,correct answer,
12,63_3,How does blockchain work?,how does blockchain technology work,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,correct answer,
8,63_3,How does blockchain work?,Blockchain is a distributed ledger technology.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,63_3,How does blockchain work?,Blockchain is a distributed ledger technology.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,positive one,false,false,,
10,63_3,How does blockchain work?,blockchain is the name of a widely used distributed ledger technology.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,good one,false,false,,
75,63_3,How does blockchain work?,blockchain is the name of a widely used distributed ledger technology.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
31,63_3,How does blockchain work?,"In blockchain technology, the data is stored in a digital record called a blockchain.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
12,63_3,How does blockchain work?,"In blockchain technology, the data is stored in a digital record called a blockchain.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
14,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
15,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
50,63_3,How does blockchain work?,"In blockchain technology, the data is stored in a digital record called a blockchain.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,the answer is not precise enough,false,true,,
5,63_3,How does blockchain work?,"In blockchain technology, the data is stored in a digital record called a blockchain.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
12,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information from multiple sources.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
11,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information from multiple sources.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
4,63_3,How does blockchain work?,Blockchain is a distributed ledger technology.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,63_3,How does blockchain work?,Blockchain is a distributed ledger technology.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,It doesn't state how it works.,false,true,,
17,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,63_3,How does blockchain work?,A blockchain is a data storage system that stores and retrieves information.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
21,63_3,How does blockchain work?,"The blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,63_3,How does blockchain work?,"The blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,63_3,How does blockchain work?,blockchain is the name of a widely used distributed ledger technology.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
15,63_3,How does blockchain work?,blockchain is the name of a widely used distributed ledger technology.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,It doesn't state how it works.,false,true,,
17,63_3,How does blockchain work?,how does blockchain technology work,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
5,63_3,How does blockchain work?,how does blockchain technology work,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
21,63_3,How does blockchain work?,"The blockchain is a distributed ledger technology that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,63_3,How does blockchain work?,"The blockchain is a distributed ledger technology that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
48,63_3,How does blockchain work?,"A blockchain is a data storage system that uses blockchain technology to store, retrieve, and distribute information.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
39,63_3,How does blockchain work?,"A blockchain is a data storage system that uses blockchain technology to store, retrieve, and distribute information.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,,
23,63_3,How does blockchain work?,"At the core of blockchain is the idea of the traditional ledger, recording transactions; whether of money goods or secure data.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
3,63_3,How does blockchain work?,"At the core of blockchain is the idea of the traditional ledger, recording transactions; whether of money goods or secure data.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
20,63_3,How does blockchain work?,A blockchain is a digital record that is stored in a data structure and can be used to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
3,63_3,How does blockchain work?,A blockchain is a digital record that is stored in a data structure and can be used to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,63_3,How does blockchain work?,Blockchain is an open-source distributed ledger technology.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,63_3,How does blockchain work?,Blockchain is an open-source distributed ledger technology.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,It doesn't state how it works.,false,true,,
21,63_3,How does blockchain work?,"Blockchain is a distributed, computerized, distributed ledger.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,63_3,How does blockchain work?,"Blockchain is a distributed, computerized, distributed ledger.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
64,63_4,What are the types of blockchain networks?,Types of blockchains include public blockchains.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
93,63_4,What are the types of blockchain networks?,Types of blockchains include public blockchains.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
8,63_4,What are the types of blockchain networks?,"The blockchain has four types of blockchain networks: public blockchains, private blockchains, semi-private blockchains, and hybrid blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,63_4,What are the types of blockchain networks?,"The blockchain has four types of blockchain networks: public blockchains, private blockchains, semi-private blockchains, and hybrid blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
20,63_4,What are the types of blockchain networks?,"There are four main types of blockchain networks. These are peer-to-peer networks, which are wired up to one another, and then connected to another.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,correct answer,
5,63_4,What are the types of blockchain networks?,"There are four main types of blockchain networks. These are peer-to-peer networks, which are wired up to one another, and then connected to another.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,random answer,
12,63_4,What are the types of blockchain networks?,"Four types of blockchain networks: consortium, private blockchains, public blockchains, and semi-private blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,63_4,What are the types of blockchain networks?,"Four types of blockchain networks: consortium, private blockchains, public blockchains, and semi-private blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
34,63_4,What are the types of blockchain networks?,"4 types of blockchain networks Of the four ways to establish a blockchain network – currently, consortium is the most accepted model for business.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
104,63_4,What are the types of blockchain networks?,"4 types of blockchain networks Of the four ways to establish a blockchain network – currently, consortium is the most accepted model for business.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
14,63_4,What are the types of blockchain networks?,There are four types of blockchain networks. Consortium blockchains are considered to be permissioned blockchains and are best suited for use in business. Semi-private blockchains are run by a single company that grants access to any user who pre-established criteria.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
22,63_4,What are the types of blockchain networks?,There are four types of blockchain networks. Consortium blockchains are considered to be permissioned blockchains and are best suited for use in business. Semi-private blockchains are run by a single company that grants access to any user who pre-established criteria.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
35,63_4,What are the types of blockchain networks?,"4 types of blockchain networks Of the four ways to establish a blockchain network – currently, consortium is the most accepted model for business.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
4,63_4,What are the types of blockchain networks?,"4 types of blockchain networks Of the four ways to establish a blockchain network – currently, consortium is the most accepted model for business.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
6,63_4,What are the types of blockchain networks?,There are four types of blockchain networks. Consortium blockchains are considered to be permissioned blockchains and are best suited for use in business. Semi-private blockchains are run by a single company that grants access to any user who pre-established criteria.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
33,63_4,What are the types of blockchain networks?,There are four types of blockchain networks. Consortium blockchains are considered to be permissioned blockchains and are best suited for use in business. Semi-private blockchains are run by a single company that grants access to any user who pre-established criteria.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,The answer is incomplete and only states two of the types.,false,true,,
29,63_4,What are the types of blockchain networks?,Types of blockchains include public blockchains.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
118,63_4,What are the types of blockchain networks?,Types of blockchains include public blockchains.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,63_4,What are the types of blockchain networks?,"Four types of blockchain networks: consortium, private blockchains, public blockchains, and semi-private blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
36,63_4,What are the types of blockchain networks?,"Four types of blockchain networks: consortium, private blockchains, public blockchains, and semi-private blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
11,63_4,What are the types of blockchain networks?,"There are four main types of blockchain networks. These are peer-to-peer networks, which are wired up to one another, and then connected to another.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
14,63_4,What are the types of blockchain networks?,"There are four main types of blockchain networks. These are peer-to-peer networks, which are wired up to one another, and then connected to another.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
16,63_4,What are the types of blockchain networks?,"The blockchain has four types of blockchain networks: public blockchains, private blockchains, semi-private blockchains, and hybrid blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
16,63_4,What are the types of blockchain networks?,"The blockchain has four types of blockchain networks: public blockchains, private blockchains, semi-private blockchains, and hybrid blockchains.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
31,63_6,How is blockchain related to cryptocurrencies?,The primary use of blockchains today is as a distributed ledger for cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
65,63_6,How is blockchain related to cryptocurrencies?,The primary use of blockchains today is as a distributed ledger for cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underpins cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
99,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underpins cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed ledger technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
25,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed ledger technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,good one,false,false,,
18,63_6,How is blockchain related to cryptocurrencies?,"The invention of the blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,true,false,correct answer,
15,63_6,How is blockchain related to cryptocurrencies?,"The invention of the blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,correct answer,
36,63_6,How is blockchain related to cryptocurrencies?,Blockchain is a distributed ledger technology that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
42,63_6,How is blockchain related to cryptocurrencies?,Blockchain is a distributed ledger technology that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
20,63_6,How is blockchain related to cryptocurrencies?,"A blockchain is a digital data storage system that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
108,63_6,How is blockchain related to cryptocurrencies?,"A blockchain is a digital data storage system that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,63_6,How is blockchain related to cryptocurrencies?,Cryptocurrency is a digital currency that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,63_6,How is blockchain related to cryptocurrencies?,Cryptocurrency is a digital currency that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
27,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underlies all cryptocurrencies.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underlies all cryptocurrencies.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed, peer-to-peer, blockchain-based blockchain technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
25,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed, peer-to-peer, blockchain-based blockchain technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
15,63_6,How is blockchain related to cryptocurrencies?,The primary use of blockchains today is as a distributed ledger for cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,63_6,How is blockchain related to cryptocurrencies?,The primary use of blockchains today is as a distributed ledger for cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
27,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed ledger technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed ledger technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
21,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underlies all cryptocurrencies.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underlies all cryptocurrencies.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underpins cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,63_6,How is blockchain related to cryptocurrencies?,Blockchain is the technology that underpins cryptocurrencies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,63_6,How is blockchain related to cryptocurrencies?,"A blockchain is a digital data storage system that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,63_6,How is blockchain related to cryptocurrencies?,"A blockchain is a digital data storage system that uses blockchain technology to store, retrieve, and distribute digital data.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
29,63_6,How is blockchain related to cryptocurrencies?,"The invention of the blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
31,63_6,How is blockchain related to cryptocurrencies?,"The invention of the blockchain is a distributed, peer-to-peer, distributed ledger technology that is being used in a number of different applications.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,INCOMPLETE,false,true,,
14,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed, peer-to-peer, blockchain-based blockchain technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
12,63_6,How is blockchain related to cryptocurrencies?,"Blockchain is a distributed, peer-to-peer, blockchain-based blockchain technology that facilitates the creation, management, and analysis of digital assets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
21,63_6,How is blockchain related to cryptocurrencies?,Blockchain is a distributed ledger technology that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
5,63_6,How is blockchain related to cryptocurrencies?,Blockchain is a distributed ledger technology that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
7,63_6,How is blockchain related to cryptocurrencies?,Cryptocurrency is a digital currency that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
17,63_6,How is blockchain related to cryptocurrencies?,Cryptocurrency is a digital currency that uses blockchain technology to store and retrieve digital data.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
27,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
85,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,confusing answer,
17,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
44,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
8,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs: Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
15,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs: Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
114,64_1,What are the types of pork ribs?,There are two types of pork ribs: pork spareribs and pork loin ribs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
61,64_1,What are the types of pork ribs?,There are two types of pork ribs: pork spareribs and pork loin ribs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,64_1,What are the types of pork ribs?,"The types of pork ribs are: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Back Ribs, Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs,",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,random answer,
14,64_1,What are the types of pork ribs?,"The types of pork ribs are: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Back Ribs, Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs,",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,true,false,correct answer,
30,64_1,What are the types of pork ribs?,"There are 8 types of pork ribs: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
11,64_1,What are the types of pork ribs?,"There are 8 types of pork ribs: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
22,64_1,What are the types of pork ribs?,"The most common types of pork ribs are Baby Back Ribs, Flanked Style Ribs, Beef Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
87,64_1,What are the types of pork ribs?,"The most common types of pork ribs are Baby Back Ribs, Flanked Style Ribs, Beef Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
18,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs: Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
5,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs: Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
14,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,64_1,What are the types of pork ribs?,"The types of pork ribs are: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Back Ribs, Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs,",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,true,false,,
12,64_1,What are the types of pork ribs?,"The types of pork ribs are: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Back Ribs, Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs,",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
42,64_1,What are the types of pork ribs?,"There are 8 different types of pork ribs. Baby Back Ribs, Beef Ribs, Country Style Pork Ribs, Flanked Style Pork Ribs, St. Louis Style Pork Ribs, and more.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,"It only lists five styles, not all of them.",false,true,,
17,64_1,What are the types of pork ribs?,"There are 8 types of pork ribs: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,64_1,What are the types of pork ribs?,"There are 8 types of pork ribs: Baby Back Ribs, Pork Spareribs, Country Style Pork Ribs, Beef Short Ribs, Flanked Style Pork Ribs, Lamb Short Ribs, and Lamb Riblets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,64_1,What are the types of pork ribs?,"The most common types of pork ribs are Baby Back Ribs, Flanked Style Ribs, Beef Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
4,64_1,What are the types of pork ribs?,"The most common types of pork ribs are Baby Back Ribs, Flanked Style Ribs, Beef Short Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs, Flanked Style Ribs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
15,64_1,What are the types of pork ribs?,There are two types of pork ribs: pork spareribs and pork loin ribs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,64_1,What are the types of pork ribs?,There are two types of pork ribs: pork spareribs and pork loin ribs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,64_2,What are baby back pork ribs?,Baby back ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,right answer,false,false,confusing answer,
25,64_2,What are baby back pork ribs?,Baby back ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
107,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs. They come from fairly high up on the back of the pig.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs. They come from fairly high up on the back of the pig.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
98,64_2,What are baby back pork ribs?,baby back ribs baby back ribs are sometimes known as loin back or just back ribs,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
20,64_2,What are baby back pork ribs?,baby back ribs baby back ribs are sometimes known as loin back or just back ribs,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
51,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
10,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,64_2,What are baby back pork ribs?,baby back ribs baby back ribs are sometimes known as loin back or just back ribs,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
4,64_2,What are baby back pork ribs?,baby back ribs baby back ribs are sometimes known as loin back or just back ribs,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
7,64_2,What are baby back pork ribs?,Baby back ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,64_2,What are baby back pork ribs?,Baby back ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs. They come from fairly high up on the back of the pig.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,64_2,What are baby back pork ribs?,Baby back pork ribs are sometimes known as loin back or just back ribs. They come from fairly high up on the back of the pig.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
59,65_3,What is the between nominal and real GDP?,Nominal GDP is the GDP which is calculated at the current market price,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
23,65_3,What is the between nominal and real GDP?,Nominal GDP is the GDP which is calculated at the current market price,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,good,false,false,confusing answer,
108,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation and hence Nominal Gross Domestic Product is considered a more apt measure of GDP.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation and hence Nominal Gross Domestic Product is considered a more apt measure of GDP.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
110,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
25,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
99,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
77,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
49,65_3,What is the between nominal and real GDP?,Real GDP is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,random answer,
44,65_3,What is the between nominal and real GDP?,Real GDP is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,correct answer,
8,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,confusing answer,
32,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,confusing answer,
11,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of products or services at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,positive one,false,false,,
9,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of products or services at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
41,65_3,What is the between nominal and real GDP?,Nominal GDP is the GDP which is calculated at the current market price,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,the answer does not clearly answer the question,false,true,,
9,65_3,What is the between nominal and real GDP?,Nominal GDP is the GDP which is calculated at the current market price,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of products or services at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of products or services at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
55,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
33,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,65_3,What is the between nominal and real GDP?,Nominal GDP is the measure of the annual production of goods or services at the current price whereas Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,65_3,What is the between nominal and real GDP?,Real GDP is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,65_3,What is the between nominal and real GDP?,Real GDP is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation and hence Nominal Gross Domestic Product is considered a more apt measure of GDP.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation and hence Nominal Gross Domestic Product is considered a more apt measure of GDP.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
73,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
4,65_3,What is the between nominal and real GDP?,Real GDP is the measure of the annual production of goods or services calculated at actual price without considering the effect of Inflation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
11,65_5,What is the meaning of GNI?,The United States' gross national product (GNI) is the total value of all goods and services produced in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,nice,false,false,,
25,65_5,What is the meaning of GNI?,The United States' gross national product (GNI) is the total value of all goods and services produced in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,65_5,What is the meaning of GNI?,Gross national income is the total value of all the goods and services produced in a particular country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
60,65_5,What is the meaning of GNI?,Gross national income is the total value of all the goods and services produced in a particular country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
45,65_5,What is the meaning of GNI?,Gross national income (GNI) is the total value of all services and goods within the borders of a nation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
21,65_5,What is the meaning of GNI?,Gross national income (GNI) is the total value of all services and goods within the borders of a nation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,65_5,What is the meaning of GNI?,GNI stands for Gross National Income.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,65_5,What is the meaning of GNI?,GNI stands for Gross National Income.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
15,65_5,What is the meaning of GNI?,GNI is the gross national income (GNI) of the member states of the European Union.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
80,65_5,What is the meaning of GNI?,GNI is the gross national income (GNI) of the member states of the European Union.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
20,65_5,What is the meaning of GNI?,Gross national income is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
57,65_5,What is the meaning of GNI?,Gross national income is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
69,65_5,What is the meaning of GNI?,Gross National Income (GNI) is the gross domestic product (GDP) of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,confusing answer,
35,65_5,What is the meaning of GNI?,Gross National Income (GNI) is the gross domestic product (GDP) of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,confusing answer,
9,65_5,What is the meaning of GNI?,GNI is the gross national income of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
13,65_5,What is the meaning of GNI?,GNI is the gross national income of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
28,65_5,What is the meaning of GNI?,Gross national income is the sum of value added by all resident producers plus any product taxes (less subsidies) not included in the valuation of output plus net receipts of primary income (compensation of employees and property income) from abroad.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
12,65_5,What is the meaning of GNI?,Gross national income is the sum of value added by all resident producers plus any product taxes (less subsidies) not included in the valuation of output plus net receipts of primary income (compensation of employees and property income) from abroad.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,65_5,What is the meaning of GNI?,GNI stands for Gross National Income.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,65_5,What is the meaning of GNI?,GNI stands for Gross National Income.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
17,65_5,What is the meaning of GNI?,Gross national income (GNI) is the total value of all services and goods within the borders of a nation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,65_5,What is the meaning of GNI?,Gross national income (GNI) is the total value of all services and goods within the borders of a nation.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
11,65_5,What is the meaning of GNI?,GNI is the gross national income of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
5,65_5,What is the meaning of GNI?,GNI is the gross national income of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
19,65_5,What is the meaning of GNI?,Gross national income is the total value of all the goods and services produced in a particular country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
28,65_5,What is the meaning of GNI?,Gross national income is the total value of all the goods and services produced in a particular country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,65_5,What is the meaning of GNI?,Gross national income is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,65_5,What is the meaning of GNI?,Gross national income is the value of all goods and services produced in a country in a given year.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
16,65_5,What is the meaning of GNI?,The United States' gross national product (GNI) is the total value of all goods and services produced in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,65_5,What is the meaning of GNI?,The United States' gross national product (GNI) is the total value of all goods and services produced in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,65_5,What is the meaning of GNI?,GNI is the gross national income (GNI) of the member states of the European Union.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,65_5,What is the meaning of GNI?,GNI is the gross national income (GNI) of the member states of the European Union.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
50,65_5,What is the meaning of GNI?,Gross National Income (GNI) is the gross domestic product (GDP) of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,65_5,What is the meaning of GNI?,Gross National Income (GNI) is the gross domestic product (GDP) of a country.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,65_5,What is the meaning of GNI?,Gross national income is the sum of value added by all resident producers plus any product taxes (less subsidies) not included in the valuation of output plus net receipts of primary income (compensation of employees and property income) from abroad.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
15,65_5,What is the meaning of GNI?,Gross national income is the sum of value added by all resident producers plus any product taxes (less subsidies) not included in the valuation of output plus net receipts of primary income (compensation of employees and property income) from abroad.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
11,65_7,What is the relationship between inflation and unemployment?,The Phillips curve shows the relationship between inflation and unemployment.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
11,65_7,What is the relationship between inflation and unemployment?,The Phillips curve shows the relationship between inflation and unemployment.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
21,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in the United States is called the Phillips curve.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in the United States is called the Phillips curve.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in a country is inverse.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,confusing answer,
24,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in a country is inverse.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,confusing answer,
84,65_7,What is the relationship between inflation and unemployment?,The Phillips curve measures the relationship between inflation and unemployment in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,true,false,random answer,
16,65_7,What is the relationship between inflation and unemployment?,The Phillips curve measures the relationship between inflation and unemployment in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,correct answer,
16,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in the United States is called the Phillips curve.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in the United States is called the Phillips curve.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,65_7,What is the relationship between inflation and unemployment?,The Phillips curve measures the relationship between inflation and unemployment in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,65_7,What is the relationship between inflation and unemployment?,The Phillips curve measures the relationship between inflation and unemployment in the United States.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
21,65_7,What is the relationship between inflation and unemployment?,The Phillips curve shows the relationship between inflation and unemployment.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
26,65_7,What is the relationship between inflation and unemployment?,The Phillips curve shows the relationship between inflation and unemployment.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,It doesn't state the relationship.,false,true,,
15,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in a country is inverse.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,65_7,What is the relationship between inflation and unemployment?,The relationship between inflation and unemployment in a country is inverse.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
99,65_8,What is frictional unemployment and why is it important?,frictional unemployment is a period when an individual is out of work but is,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
65,65_8,What is frictional unemployment and why is it important?,frictional unemployment is a period when an individual is out of work but is,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
18,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
18,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
33,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when workers are jobless and looking for work in a healthy economy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when workers are jobless and looking for work in a healthy economy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,confusing answer,
19,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,confusing answer,
64,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
12,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,confusing answer,
35,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is a period when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
102,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is a period when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is the unemployment that occurs when workers are laid off from their jobs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
105,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is the unemployment that occurs when workers are laid off from their jobs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,65_8,What is frictional unemployment and why is it important?,definition : frictional unemployment exists when individuals are out of work but are likely to be re - employed soon,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,correct answer,
20,65_8,What is frictional unemployment and why is it important?,definition : frictional unemployment exists when individuals are out of work but are likely to be re - employed soon,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,correct answer,
18,65_8,What is frictional unemployment and why is it important?,Frictional Unemployment is a term used to describe the state of unemployment in the United States during the Great Depression.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
77,65_8,What is frictional unemployment and why is it important?,Frictional Unemployment is a term used to describe the state of unemployment in the United States during the Great Depression.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
5,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is the unemployment that occurs when workers are laid off from their jobs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
29,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is the unemployment that occurs when workers are laid off from their jobs.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,It doesn't state why it is important.,false,true,,
16,65_8,What is frictional unemployment and why is it important?,frictional unemployment is a period when an individual is out of work but is,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
4,65_8,What is frictional unemployment and why is it important?,frictional unemployment is a period when an individual is out of work but is,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
13,65_8,What is frictional unemployment and why is it important?,Frictional Unemployment is a term used to describe the state of unemployment in the United States during the Great Depression.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,65_8,What is frictional unemployment and why is it important?,Frictional Unemployment is a term used to describe the state of unemployment in the United States during the Great Depression.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
28,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is a period when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is a period when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,65_8,What is frictional unemployment and why is it important?,definition : frictional unemployment exists when individuals are out of work but are likely to be re - employed soon,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
10,65_8,What is frictional unemployment and why is it important?,definition : frictional unemployment exists when individuals are out of work but are likely to be re - employed soon,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
19,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
18,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when workers are jobless and looking for work in a healthy economy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
21,65_8,What is frictional unemployment and why is it important?,Frictional unemployment is when workers are jobless and looking for work in a healthy economy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
6,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon. It is usually a period when a job seeker is temporarily unemployed as he or she is in the process of looking for a suitable position.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
33,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
19,65_8,What is frictional unemployment and why is it important?,Frictional unemployment occurs when individuals are out of work but are likely to be re-employed soon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
87,66_5,What variety of lavender is best for cooking?,English lavender and Provence lavender are the two types most usually used in cooking.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,66_5,What variety of lavender is best for cooking?,English lavender and Provence lavender are the two types most usually used in cooking.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
82,66_5,What variety of lavender is best for cooking?,"The classic English lavender is the most popular type of culinary lavender, with all its cultivars being suitable for edible uses.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,66_5,What variety of lavender is best for cooking?,"The classic English lavender is the most popular type of culinary lavender, with all its cultivars being suitable for edible uses.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,positive one,false,false,,
29,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
9,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
31,66_5,What variety of lavender is best for cooking?,"Lavender is the most popular vegetable in the world for cooking, with a wide variety of colors. The plant also has a",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,correct answer,
104,66_5,What variety of lavender is best for cooking?,"Lavender is the most popular vegetable in the world for cooking, with a wide variety of colors. The plant also has a",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,correct answer,
62,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead purple and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
47,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead purple and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
89,66_5,What variety of lavender is best for cooking?,"the most widely available species of english lavender is lavandula angustifolia, and two popular varieties used for culinary purposes are munstead and hidcote. look to provence french lavender is a hybrid plant that goes by the scientific name lavandula x intermedia. if you want the true provence lavender experience, the best variety to look for it, unsurprisingly, is provence. it's widely regarded as the best french lavender for culinary uses",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
12,66_5,What variety of lavender is best for cooking?,"the most widely available species of english lavender is lavandula angustifolia, and two popular varieties used for culinary purposes are munstead and hidcote. look to provence french lavender is a hybrid plant that goes by the scientific name lavandula x intermedia. if you want the true provence lavender experience, the best variety to look for it, unsurprisingly, is provence. it's widely regarded as the best french lavender for culinary uses",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
9,66_5,What variety of lavender is best for cooking?,"The classic English lavender is the most popular type of culinary lavender, with all its cultivars being suitable for edible uses.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,66_5,What variety of lavender is best for cooking?,"The classic English lavender is the most popular type of culinary lavender, with all its cultivars being suitable for edible uses.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
21,66_5,What variety of lavender is best for cooking?,English lavender and Provence lavender are the two types most usually used in cooking.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,66_5,What variety of lavender is best for cooking?,English lavender and Provence lavender are the two types most usually used in cooking.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
26,66_5,What variety of lavender is best for cooking?,"Lavender is the most popular vegetable in the world for cooking, with a wide variety of colors. The plant also has a",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,INCOMPLETE,false,true,,
6,66_5,What variety of lavender is best for cooking?,"Lavender is the most popular vegetable in the world for cooking, with a wide variety of colors. The plant also has a",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,,
35,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead purple and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
27,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead purple and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,GOOD,false,false,,
54,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
3,66_5,What variety of lavender is best for cooking?,"The most widely available species of English lavender is Lavandula angustifolia, and two popular varieties used for culinary purposes are Munstead and Hidcote.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
27,66_5,What variety of lavender is best for cooking?,"the most widely available species of english lavender is lavandula angustifolia, and two popular varieties used for culinary purposes are munstead and hidcote. look to provence french lavender is a hybrid plant that goes by the scientific name lavandula x intermedia. if you want the true provence lavender experience, the best variety to look for it, unsurprisingly, is provence. it's widely regarded as the best french lavender for culinary uses",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
67,66_5,What variety of lavender is best for cooking?,"the most widely available species of english lavender is lavandula angustifolia, and two popular varieties used for culinary purposes are munstead and hidcote. look to provence french lavender is a hybrid plant that goes by the scientific name lavandula x intermedia. if you want the true provence lavender experience, the best variety to look for it, unsurprisingly, is provence. it's widely regarded as the best french lavender for culinary uses",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,NICE,false,true,,
24,66_7,What foods is lavender good for cooking with?,"Lavender is an incredibly versatile herb for cooking. In today’s upscale restaurants, fresh edible flowers are making a comeback as enhancements to both the flavor and appearance of food.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
52,66_7,What foods is lavender good for cooking with?,"Lavender is an incredibly versatile herb for cooking. In today’s upscale restaurants, fresh edible flowers are making a comeback as enhancements to both the flavor and appearance of food.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,66_7,What foods is lavender good for cooking with?,"English Lavender is known for its sweet, less bitter floral note when added to teas and other dishes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,confusing answer,
34,66_7,What foods is lavender good for cooking with?,"English Lavender is known for its sweet, less bitter floral note when added to teas and other dishes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,confusing answer,
29,66_7,What foods is lavender good for cooking with?,"lavender is great for cooking with pints of butter, jam, olive oil",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
72,66_7,What foods is lavender good for cooking with?,"lavender is great for cooking with pints of butter, jam, olive oil",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
111,66_7,What foods is lavender good for cooking with?,"Lavender has a sweet, floral flavor, with lemon and citrus notes.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,false,,false,true,correct answer,
80,66_7,What foods is lavender good for cooking with?,"Lavender has a sweet, floral flavor, with lemon and citrus notes.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,random answer,
4,66_7,What foods is lavender good for cooking with?,"Lavender has a sweet, floral flavor, with lemon and citrus notes.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
17,66_7,What foods is lavender good for cooking with?,"Lavender has a sweet, floral flavor, with lemon and citrus notes.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,NICE,false,false,,
38,66_7,What foods is lavender good for cooking with?,"Lavender is an incredibly versatile herb for cooking. In today’s upscale restaurants, fresh edible flowers are making a comeback as enhancements to both the flavor and appearance of food.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
13,66_7,What foods is lavender good for cooking with?,"Lavender is an incredibly versatile herb for cooking. In today’s upscale restaurants, fresh edible flowers are making a comeback as enhancements to both the flavor and appearance of food.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
14,66_7,What foods is lavender good for cooking with?,"English Lavender is known for its sweet, less bitter floral note when added to teas and other dishes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,66_7,What foods is lavender good for cooking with?,"English Lavender is known for its sweet, less bitter floral note when added to teas and other dishes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
22,66_7,What foods is lavender good for cooking with?,"lavender is great for cooking with pints of butter, jam, olive oil",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
111,66_7,What foods is lavender good for cooking with?,"lavender is great for cooking with pints of butter, jam, olive oil",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,"The pungent flavor of lavender pairs with light and bright flavors, like lemon, berries, honey, and mint. It's great in baked goods, ice creams, and in some savory dishes (like a dry rub)",false,true,,
20,67_6,What are the symptoms of anemia?,Symptoms common to many types of anemia include the following: Easy fatigue and loss of energy,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
25,67_6,What are the symptoms of anemia?,Symptoms common to many types of anemia include the following: Easy fatigue and loss of energy,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
81,67_6,What are the symptoms of anemia?,"The symptoms of anemia include:Anemia, hypertension, and hypoglycemia.Anemia is a condition where the body does not properly diagnose and treat",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
11,67_6,What are the symptoms of anemia?,"The symptoms of anemia include:Anemia, hypertension, and hypoglycemia.Anemia is a condition where the body does not properly diagnose and treat",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,good one,false,false,,
86,67_6,What are the symptoms of anemia?,"The symptoms of anemia in animals include: fever, chills, fatigue, and sleepiness.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,67_6,What are the symptoms of anemia?,"The symptoms of anemia in animals include: fever, chills, fatigue, and sleepiness.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
59,67_6,What are the symptoms of anemia?," The symptoms of anemia are fatigue, shortness of breath, and pale skin.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
6,67_6,What are the symptoms of anemia?," The symptoms of anemia are fatigue, shortness of breath, and pale skin.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,67_6,What are the symptoms of anemia?,"The symptoms of anemia include:Anemia, hypertension, and hypoglycemia.Anemia is a condition where the body does not properly diagnose and treat",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
4,67_6,What are the symptoms of anemia?,"The symptoms of anemia include:Anemia, hypertension, and hypoglycemia.Anemia is a condition where the body does not properly diagnose and treat",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
12,67_6,What are the symptoms of anemia?,"The symptoms of anemia in animals include: fever, chills, fatigue, and sleepiness.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,67_6,What are the symptoms of anemia?,"The symptoms of anemia in animals include: fever, chills, fatigue, and sleepiness.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
4,67_6,What are the symptoms of anemia?,Symptoms common to many types of anemia include the following: Easy fatigue and loss of energy,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
16,67_6,What are the symptoms of anemia?,Symptoms common to many types of anemia include the following: Easy fatigue and loss of energy,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,GOOD,false,false,,
5,67_6,What are the symptoms of anemia?," The symptoms of anemia are fatigue, shortness of breath, and pale skin.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
7,67_6,What are the symptoms of anemia?," The symptoms of anemia are fatigue, shortness of breath, and pale skin.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
89,67_8,What are anemia's possible causes?,Anemia can be caused by a variety of causes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
94,67_8,What are anemia's possible causes?,Anemia can be caused by a variety of causes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,random answer,
13,67_8,What are anemia's possible causes?,"Anemia can be caused by a number of factors, including age, smoking, diabetes, thyroid disease, sleep apnea, and poor diet.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,positive one,false,false,,
6,67_8,What are anemia's possible causes?,"Anemia can be caused by a number of factors, including age, smoking, diabetes, thyroid disease, sleep apnea, and poor diet.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
69,67_8,What are anemia's possible causes?,There are a number of possible causes of anemia in animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,correct answer,
8,67_8,What are anemia's possible causes?,There are a number of possible causes of anemia in animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,correct answer,
14,67_8,What are anemia's possible causes?,"Anemia can be caused by a variety of causes, including genetic, environmental, or lifestyle factors.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
15,67_8,What are anemia's possible causes?,"Anemia can be caused by a variety of causes, including genetic, environmental, or lifestyle factors.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,true,false,random answer,
37,67_8,What are anemia's possible causes?,Anemia can be caused by a number of possible causes.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,67_8,What are anemia's possible causes?,Anemia can be caused by a number of possible causes.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,67_8,What are anemia's possible causes?,The most common causes of anemia are iron deficiency and chronic diarrhea.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,67_8,What are anemia's possible causes?,The most common causes of anemia are iron deficiency and chronic diarrhea.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
10,67_8,What are anemia's possible causes?,The most common causes of anemia are iron deficiency and chronic diarrhea.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
21,67_8,What are anemia's possible causes?,The most common causes of anemia are iron deficiency and chronic diarrhea.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,GOOD,false,false,,
8,67_8,What are anemia's possible causes?,"Anemia can be caused by a number of factors, including age, smoking, diabetes, thyroid disease, sleep apnea, and poor diet.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
83,67_8,What are anemia's possible causes?,"Anemia can be caused by a number of factors, including age, smoking, diabetes, thyroid disease, sleep apnea, and poor diet.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,67_8,What are anemia's possible causes?,There are a number of possible causes of anemia in animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
12,67_8,What are anemia's possible causes?,There are a number of possible causes of anemia in animals.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,67_8,What are anemia's possible causes?,Anemia can be caused by a number of possible causes.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
3,67_8,What are anemia's possible causes?,Anemia can be caused by a number of possible causes.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,67_8,What are anemia's possible causes?,Anemia can be caused by a variety of causes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
4,67_8,What are anemia's possible causes?,Anemia can be caused by a variety of causes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
15,67_8,What are anemia's possible causes?,"Anemia can be caused by a variety of causes, including genetic, environmental, or lifestyle factors.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,67_8,What are anemia's possible causes?,"Anemia can be caused by a variety of causes, including genetic, environmental, or lifestyle factors.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
41,68_11,What are common variations of tagliatelle al ragu bolognese?,There are many variations of tagliatelle al ragu bolognese.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
76,68_11,What are common variations of tagliatelle al ragu bolognese?,There are many variations of tagliatelle al ragu bolognese.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
10,68_11,What are common variations of tagliatelle al ragu bolognese?,Tagliatelle al ragu bolognese is traditionally paired and served with tagliatelle made with eggs and northern Italy's soft wheat flour.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,correct answer,
45,68_11,What are common variations of tagliatelle al ragu bolognese?,Tagliatelle al ragu bolognese is traditionally paired and served with tagliatelle made with eggs and northern Italy's soft wheat flour.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,random answer,
36,68_11,What are common variations of tagliatelle al ragu bolognese?,Common variations of tagliatelle al ragu bolognese include:,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
27,68_11,What are common variations of tagliatelle al ragu bolognese?,Common variations of tagliatelle al ragu bolognese include:,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,68_11,What are common variations of tagliatelle al ragu bolognese?,"Variations of tagliatelle al ragu bolognese include tagliatelle al ragu bolognese, tagliatelle al giorno, tagliatelle al ragu bolognese,",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
22,68_11,What are common variations of tagliatelle al ragu bolognese?,"Variations of tagliatelle al ragu bolognese include tagliatelle al ragu bolognese, tagliatelle al giorno, tagliatelle al ragu bolognese,",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,68_11,What are common variations of tagliatelle al ragu bolognese?,"Variations of tagliatelle al ragu bolognese include tagliatelle al ragu bolognese, tagliatelle al giorno, tagliatelle al ragu bolognese,",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,68_11,What are common variations of tagliatelle al ragu bolognese?,"Variations of tagliatelle al ragu bolognese include tagliatelle al ragu bolognese, tagliatelle al giorno, tagliatelle al ragu bolognese,",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,68_11,What are common variations of tagliatelle al ragu bolognese?,There are many variations of tagliatelle al ragu bolognese.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
13,68_11,What are common variations of tagliatelle al ragu bolognese?,There are many variations of tagliatelle al ragu bolognese.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,GOOD,false,false,,
6,68_11,What are common variations of tagliatelle al ragu bolognese?,Common variations of tagliatelle al ragu bolognese include:,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
22,68_11,What are common variations of tagliatelle al ragu bolognese?,Common variations of tagliatelle al ragu bolognese include:,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,GOOD,false,false,,
17,68_11,What are common variations of tagliatelle al ragu bolognese?,Tagliatelle al ragu bolognese is traditionally paired and served with tagliatelle made with eggs and northern Italy's soft wheat flour.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,68_11,What are common variations of tagliatelle al ragu bolognese?,Tagliatelle al ragu bolognese is traditionally paired and served with tagliatelle made with eggs and northern Italy's soft wheat flour.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is produced from the juice of just-harvested white grapes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
54,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is produced from the juice of just-harvested white grapes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
22,68_4,Describe the traditional process for making balsamic vinegar.,"Traditional processes [ edit ] Main article: Traditional Balsamic Vinegar Barrels of balsamic vinegar aging Traditional balsamic vinegar is produced from the juice of just-harvested white grapes (typically, Trebbiano grapes) boiled down to reach a minimum sugar concentration of 30% (brix) or more in the must , which is then fermented with a slow aging process which further concentrates the flavours.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
97,68_4,Describe the traditional process for making balsamic vinegar.,"Traditional processes [ edit ] Main article: Traditional Balsamic Vinegar Barrels of balsamic vinegar aging Traditional balsamic vinegar is produced from the juice of just-harvested white grapes (typically, Trebbiano grapes) boiled down to reach a minimum sugar concentration of 30% (brix) or more in the must , which is then fermented with a slow aging process which further concentrates the flavours.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
14,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is made by slowly cooking white wine vinegar with sugar and a variety of spices.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is made by slowly cooking white wine vinegar with sugar and a variety of spices.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
37,68_4,Describe the traditional process for making balsamic vinegar.,true balsamic vinegar is made from a reduction of pressed trebbiano and lambrusco grapes,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
60,68_4,Describe the traditional process for making balsamic vinegar.,true balsamic vinegar is made from a reduction of pressed trebbiano and lambrusco grapes,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
15,68_4,Describe the traditional process for making balsamic vinegar.,true balsamic vinegar is made from a reduction of pressed trebbiano and lambrusco grapes,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
17,68_4,Describe the traditional process for making balsamic vinegar.,true balsamic vinegar is made from a reduction of pressed trebbiano and lambrusco grapes,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,NICE,false,false,,
11,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is produced from the juice of just-harvested white grapes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
24,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is produced from the juice of just-harvested white grapes.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
59,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is made by slowly cooking white wine vinegar with sugar and a variety of spices.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,68_4,Describe the traditional process for making balsamic vinegar.,Traditional balsamic vinegar is made by slowly cooking white wine vinegar with sugar and a variety of spices.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
38,68_4,Describe the traditional process for making balsamic vinegar.,"Traditional processes [ edit ] Main article: Traditional Balsamic Vinegar Barrels of balsamic vinegar aging Traditional balsamic vinegar is produced from the juice of just-harvested white grapes (typically, Trebbiano grapes) boiled down to reach a minimum sugar concentration of 30% (brix) or more in the must , which is then fermented with a slow aging process which further concentrates the flavours.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
22,68_4,Describe the traditional process for making balsamic vinegar.,"Traditional processes [ edit ] Main article: Traditional Balsamic Vinegar Barrels of balsamic vinegar aging Traditional balsamic vinegar is produced from the juice of just-harvested white grapes (typically, Trebbiano grapes) boiled down to reach a minimum sugar concentration of 30% (brix) or more in the must , which is then fermented with a slow aging process which further concentrates the flavours.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
19,68_6,What's the difference between mortadella and bologna?,"As nouns the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,confusing answer,
11,68_6,What's the difference between mortadella and bologna?,"As nouns the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,confusing answer,
72,68_6,What's the difference between mortadella and bologna?,"As the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be nonsense.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
97,68_6,What's the difference between mortadella and bologna?,"As the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be nonsense.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,false,true,confusing answer,
50,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,confusing answer,
19,68_6,What's the difference between mortadella and bologna?,"Bologna is a synonym of mortadella while mortadella is a smooth-textured Italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
20,68_6,What's the difference between mortadella and bologna?,"Bologna is a synonym of mortadella while mortadella is a smooth-textured Italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,confusing answer,
15,68_6,What's the difference between mortadella and bologna?,as nouns the difference between bologna and mortadella is that bologna is a smoked,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,positive one,false,false,random answer,
12,68_6,What's the difference between mortadella and bologna?,as nouns the difference between bologna and mortadella is that bologna is a smoked,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,correct answer,
111,68_6,What's the difference between mortadella and bologna?,"Bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna while mortadella is a smooth-textured italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
12,68_6,What's the difference between mortadella and bologna?,"Bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna while mortadella is a smooth-textured italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
100,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
24,68_6,What's the difference between mortadella and bologna?,as nouns the difference between bologna and mortadella is that bologna is a smoked,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,INCOMPLETE SENTENCE,false,false,,
15,68_6,What's the difference between mortadella and bologna?,as nouns the difference between bologna and mortadella is that bologna is a smoked,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,GOOD,false,false,,
7,68_6,What's the difference between mortadella and bologna?,"Bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna while mortadella is a smooth-textured italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,68_6,What's the difference between mortadella and bologna?,"Bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna while mortadella is a smooth-textured italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
73,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
38,68_6,What's the difference between mortadella and bologna?,"As the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be nonsense.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,true,false,,
6,68_6,What's the difference between mortadella and bologna?,"As the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be nonsense.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,68_6,What's the difference between mortadella and bologna?,"Bologna is a synonym of mortadella while mortadella is a smooth-textured Italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
18,68_6,What's the difference between mortadella and bologna?,"Bologna is a synonym of mortadella while mortadella is a smooth-textured Italian pork sausage with lumps of fat, flavoured with spices; eaten cold.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
11,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,68_6,What's the difference between mortadella and bologna?,"The difference between bologna and mortadella is that bologna is a smoked, italian sausage made from beef, pork or veal or bologna can be (nonsense) while mortadella is a smooth-textured italian pork sausage with lumps of fat.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,68_6,What's the difference between mortadella and bologna?,"As nouns the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
50,68_6,What's the difference between mortadella and bologna?,"As nouns the difference between bologna and mortadella is that bologna is a smoked, seasoned italian sausage made from beef, pork or veal or bologna can be.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,true,false,,
22,69_2,Does melatonin help with jet lag?,"In one study, passengers taking melatonin before, during or after an eastward flight found relief for jet lag although the effect was less pronounced for those flying westward.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
57,69_2,Does melatonin help with jet lag?,"In one study, passengers taking melatonin before, during or after an eastward flight found relief for jet lag although the effect was less pronounced for those flying westward.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
59,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as alertness and movement coordination.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,random answer,
14,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as alertness and movement coordination.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
72,69_2,Does melatonin help with jet lag?,Melatonin can help you fall asleep after jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
42,69_2,Does melatonin help with jet lag?,Melatonin can help you fall asleep after jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,69_2,Does melatonin help with jet lag?,"Melatonin may be helpful in dealing with jet lag, but not necessarily helping alleviate stress and anxiety.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
72,69_2,Does melatonin help with jet lag?,"Melatonin may be helpful in dealing with jet lag, but not necessarily helping alleviate stress and anxiety.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
95,69_2,Does melatonin help with jet lag?,Studies have shown that Melatonin reduces symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
20,69_2,Does melatonin help with jet lag?,Studies have shown that Melatonin reduces symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as sleepiness and movement coordination. Melatonin also seems to slightly improve other jet lag symptoms such as daytime sleepiness and tiredness.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
113,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as sleepiness and movement coordination. Melatonin also seems to slightly improve other jet lag symptoms such as daytime sleepiness and tiredness.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
21,69_2,Does melatonin help with jet lag?,The National Center for Complementary and Integrative Health has the following list of health benefits for people who take Melatonin: Jet Lag Jet lag prevents people who travel from getting a good sleep at night.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,false,true,correct answer,
84,69_2,Does melatonin help with jet lag?,The National Center for Complementary and Integrative Health has the following list of health benefits for people who take Melatonin: Jet Lag Jet lag prevents people who travel from getting a good sleep at night.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,random answer,
6,69_2,Does melatonin help with jet lag?,Melatonin has been shown to reduce symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
39,69_2,Does melatonin help with jet lag?,Melatonin has been shown to reduce symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,69_2,Does melatonin help with jet lag?,Melatonin has been shown to reduce symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,69_2,Does melatonin help with jet lag?,Melatonin has been shown to reduce symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
18,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as sleepiness and movement coordination. Melatonin also seems to slightly improve other jet lag symptoms such as daytime sleepiness and tiredness.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
25,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as sleepiness and movement coordination. Melatonin also seems to slightly improve other jet lag symptoms such as daytime sleepiness and tiredness.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
3,69_2,Does melatonin help with jet lag?,Studies have shown that Melatonin reduces symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,69_2,Does melatonin help with jet lag?,Studies have shown that Melatonin reduces symptoms of jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,GOOD,false,false,,
12,69_2,Does melatonin help with jet lag?,"Melatonin may be helpful in dealing with jet lag, but not necessarily helping alleviate stress and anxiety.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
16,69_2,Does melatonin help with jet lag?,"Melatonin may be helpful in dealing with jet lag, but not necessarily helping alleviate stress and anxiety.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
60,69_2,Does melatonin help with jet lag?,The National Center for Complementary and Integrative Health has the following list of health benefits for people who take Melatonin: Jet Lag Jet lag prevents people who travel from getting a good sleep at night.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
10,69_2,Does melatonin help with jet lag?,The National Center for Complementary and Integrative Health has the following list of health benefits for people who take Melatonin: Jet Lag Jet lag prevents people who travel from getting a good sleep at night.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
15,69_2,Does melatonin help with jet lag?,Melatonin can help you fall asleep after jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,69_2,Does melatonin help with jet lag?,Melatonin can help you fall asleep after jet lag.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as alertness and movement coordination.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,69_2,Does melatonin help with jet lag?,Most research shows that melatonin can improve certain symptoms of jet lag such as alertness and movement coordination.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
13,69_2,Does melatonin help with jet lag?,"In one study, passengers taking melatonin before, during or after an eastward flight found relief for jet lag although the effect was less pronounced for those flying westward.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
14,69_2,Does melatonin help with jet lag?,"In one study, passengers taking melatonin before, during or after an eastward flight found relief for jet lag although the effect was less pronounced for those flying westward.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
103,69_4,What are good sources of melatonin in food?,"Good sources of melatonin include meats, grains, fruits, and vegetables.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,69_4,What are good sources of melatonin in food?,"Good sources of melatonin include meats, grains, fruits, and vegetables.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,right answer,false,false,,
12,69_4,What are good sources of melatonin in food?,"The best sources of melatonin in food are: fish, nuts, and seeds.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,nice,false,false,,
10,69_4,What are good sources of melatonin in food?,"The best sources of melatonin in food are: fish, nuts, and seeds.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
18,69_4,What are good sources of melatonin in food?,"Some good sources of food derived from Melatonin are: Nuts, Seeds, Canned Vegetables, Broths, Canned Meat, Broths, Canned Vegetables, Broths, Broths, Broths, Canned Meat, Canned Vegetables, Broths, Broths.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
15,69_4,What are good sources of melatonin in food?,"Some good sources of food derived from Melatonin are: Nuts, Seeds, Canned Vegetables, Broths, Canned Meat, Broths, Canned Vegetables, Broths, Broths, Broths, Canned Meat, Canned Vegetables, Broths, Broths.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,positive one,false,false,,
9,69_4,What are good sources of melatonin in food?,"The best sources of melatonin in food are: fish, nuts, and seeds.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
13,69_4,What are good sources of melatonin in food?,"The best sources of melatonin in food are: fish, nuts, and seeds.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,GOOD,false,false,,
20,69_4,What are good sources of melatonin in food?,"Some good sources of food derived from Melatonin are: Nuts, Seeds, Canned Vegetables, Broths, Canned Meat, Broths, Canned Vegetables, Broths, Broths, Broths, Canned Meat, Canned Vegetables, Broths, Broths.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
15,69_4,What are good sources of melatonin in food?,"Some good sources of food derived from Melatonin are: Nuts, Seeds, Canned Vegetables, Broths, Canned Meat, Broths, Canned Vegetables, Broths, Broths, Broths, Canned Meat, Canned Vegetables, Broths, Broths.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,NICE,false,false,,
72,69_4,What are good sources of melatonin in food?,"Good sources of melatonin include meats, grains, fruits, and vegetables.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
5,69_4,What are good sources of melatonin in food?,"Good sources of melatonin include meats, grains, fruits, and vegetables.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,69_6,What are the side effects of melatonin?,"There are potential side effects from taking melatonin, including headache, short-term sleepiness, dizziness, stomach irritability, and insomnia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,random answer,
11,69_6,What are the side effects of melatonin?,"There are potential side effects from taking melatonin, including headache, short-term sleepiness, dizziness, stomach irritability, and insomnia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
56,69_6,What are the side effects of melatonin?,"There are potential side effects including headache, short-term feelings of depression, daytime sleepiness, dizziness, stomach cramps, and irritability.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,69_6,What are the side effects of melatonin?,"There are potential side effects including headache, short-term feelings of depression, daytime sleepiness, dizziness, stomach cramps, and irritability.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
84,69_6,What are the side effects of melatonin?,there are potential side effects including headache,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,confusing answer,
51,69_6,What are the side effects of melatonin?,there are potential side effects including headache,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,confusing answer,
19,69_6,What are the side effects of melatonin?,"There are potential side effects including headache, short-term feelings of depression, daytime sleepiness, dizziness, stomach cramps, and irritability.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,69_6,What are the side effects of melatonin?,"There are potential side effects including headache, short-term feelings of depression, daytime sleepiness, dizziness, stomach cramps, and irritability.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,69_6,What are the side effects of melatonin?,"There are potential side effects from taking melatonin, including headache, short-term sleepiness, dizziness, stomach irritability, and insomnia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,69_6,What are the side effects of melatonin?,"There are potential side effects from taking melatonin, including headache, short-term sleepiness, dizziness, stomach irritability, and insomnia.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,69_6,What are the side effects of melatonin?,there are potential side effects including headache,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
14,69_6,What are the side effects of melatonin?,there are potential side effects including headache,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,GOOD,false,false,,
22,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans since the 1940s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
76,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans since the 1940s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
32,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving the timing of sleep in humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving the timing of sleep in humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,positive one,false,false,,
29,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective for the treatment of insomnia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective for the treatment of insomnia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
33,69_9,Is melatonin effective for treating insomnia?,"Melatonin has been found effective in improving sleep quality,sleep efficacy and also in reducing the sleep onset time when compared to melatonin or slow melatonin preparations.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,69_9,Is melatonin effective for treating insomnia?,"Melatonin has been found effective in improving sleep quality,sleep efficacy and also in reducing the sleep onset time when compared to melatonin or slow melatonin preparations.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
67,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving sleep quality in children.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
97,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving sleep quality in children.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,69_9,Is melatonin effective for treating insomnia?,Melatonin can be used to treat insomnia.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
104,69_9,Is melatonin effective for treating insomnia?,Melatonin can be used to treat insomnia.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
63,69_9,Is melatonin effective for treating insomnia?,"yes, melatonin can be used to relieve insomnia",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
14,69_9,Is melatonin effective for treating insomnia?,"yes, melatonin can be used to relieve insomnia",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,good one,false,false,,
56,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans for more than 50 years.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
8,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans for more than 50 years.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
33,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in animals and humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
7,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in animals and humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
47,69_9,Is melatonin effective for treating insomnia?,"Melatonin has been found effective in improving sleep quality,sleep efficacy and also in reducing the sleep onset time when compared to melatonin or slow melatonin preparations.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,"While the answer doesn't refer to insomnia, it does mention improving sleep quality.",false,false,,
22,69_9,Is melatonin effective for treating insomnia?,"Melatonin has been found effective in improving sleep quality,sleep efficacy and also in reducing the sleep onset time when compared to melatonin or slow melatonin preparations.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
52,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving the timing of sleep in humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving the timing of sleep in humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
18,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans since the 1940s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans since the 1940s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,NICE,false,false,,
18,69_9,Is melatonin effective for treating insomnia?,"yes, melatonin can be used to relieve insomnia",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
5,69_9,Is melatonin effective for treating insomnia?,"yes, melatonin can be used to relieve insomnia",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
11,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans for more than 50 years.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
20,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in humans for more than 50 years.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,It doesn't state if it is effective.,false,true,,
29,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in animals and humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,69_9,Is melatonin effective for treating insomnia?,Melatonin has been used for treatment of insomnia in animals and humans.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,false,true,,
10,69_9,Is melatonin effective for treating insomnia?,Melatonin can be used to treat insomnia.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
29,69_9,Is melatonin effective for treating insomnia?,Melatonin can be used to treat insomnia.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
33,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving sleep quality in children.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
19,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective in improving sleep quality in children.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective for the treatment of insomnia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
20,69_9,Is melatonin effective for treating insomnia?,Melatonin has been found to be effective for the treatment of insomnia.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
75,7_3,What are carbohydrates composed of?,"Carbohydrates are composed of carbon atoms and water molecules. As noted by the name, carbohydrates are composed of carbon atoms and water molecules.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,7_3,What are carbohydrates composed of?,"Carbohydrates are composed of carbon atoms and water molecules. As noted by the name, carbohydrates are composed of carbon atoms and water molecules.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
99,7_3,What are carbohydrates composed of?,"Carbohydrates are composed of carbon, hydrogen, and oxygen.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,true,false,random answer,
5,7_3,What are carbohydrates composed of?,"Carbohydrates are composed of carbon, hydrogen, and oxygen.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,7_3,What are carbohydrates composed of?,Carbohydrates are composed of carbon atoms and water molecules.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,7_3,What are carbohydrates composed of?,Carbohydrates are composed of carbon atoms and water molecules.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,7_4,What are carbohydrates basic structure?,"The general empirical structure for carbohydrates is (CH2O)n. Monosaccharides, which are simple sugars that serve as fuel molecules as",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
71,7_4,What are carbohydrates basic structure?,"The general empirical structure for carbohydrates is (CH2O)n. Monosaccharides, which are simple sugars that serve as fuel molecules as",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
85,7_4,What are carbohydrates basic structure?,"The basic structure of carbohydrates is simple sugars, starches, pectic substances, lignin, and cellulose.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,7_4,What are carbohydrates basic structure?,"The basic structure of carbohydrates is simple sugars, starches, pectic substances, lignin, and cellulose.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
60,7_4,What are carbohydrates basic structure?,"The basic structure of carbohydrates is simple sugars, starches, pectic substances, lignin, and polysaccharides.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,7_4,What are carbohydrates basic structure?,"The basic structure of carbohydrates is simple sugars, starches, pectic substances, lignin, and polysaccharides.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
18,7_6,Tell me about lipids.,Lipids are a type of polysaccharide found in plants and animals.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,7_6,Tell me about lipids.,Lipids are a type of polysaccharide found in plants and animals.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
8,7_6,Tell me about lipids.,"Lipids are the structural components of cell membranes, and form various monomeric and signaling molecules within the body.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,7_6,Tell me about lipids.,"Lipids are the structural components of cell membranes, and form various monomeric and signaling molecules within the body.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
44,7_6,Tell me about lipids.,Lipids are molecules that contain hydrocarbons and make up the building blocks of the structure and function of living cells. Examples of lipids include,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
14,7_6,Tell me about lipids.,Lipids are molecules that contain hydrocarbons and make up the building blocks of the structure and function of living cells. Examples of lipids include,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
57,7_6,Tell me about lipids.,A lipid is a group of molecules that make up the basic building blocks of the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
9,7_6,Tell me about lipids.,A lipid is a group of molecules that make up the basic building blocks of the body.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,nice,false,false,correct answer,
115,7_6,Tell me about lipids.,"Lipids are organic compounds that contain carbon, hydrogen, and oxygen.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
72,7_6,Tell me about lipids.,"Lipids are organic compounds that contain carbon, hydrogen, and oxygen.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
65,7_6,Tell me about lipids.,A lipid is a lipid that is present in the blood.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
6,7_6,Tell me about lipids.,A lipid is a lipid that is present in the blood.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
84,7_6,Tell me about lipids.,A lipid is a lipid that is found in the body.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,correct answer,
20,7_6,Tell me about lipids.,A lipid is a lipid that is found in the body.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,correct answer,
9,7_7,What are the functions of lipids.,Lipids are molecules that contain hydrocarbons and make up the building blocks of the structure and function of living cells.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
3,7_7,What are the functions of lipids.,Lipids are molecules that contain hydrocarbons and make up the building blocks of the structure and function of living cells.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
27,7_7,What are the functions of lipids.,"Lipids are the structural components of cell membranes, and form various lipid complexes and signaling molecules within the body.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
24,7_7,What are the functions of lipids.,"Lipids are the structural components of cell membranes, and form various lipid complexes and signaling molecules within the body.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,nice,false,false,,
16,7_7,What are the functions of lipids.,"The main biological functions of lipids include energy, as lipids may be broken down to yield large amounts of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
17,7_7,What are the functions of lipids.,"The main biological functions of lipids include energy, as lipids may be broken down to yield large amounts of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,7_7,What are the functions of lipids.,"The main biological functions of lipids include storing energy, as lipids may be broken down to yield large amounts of hydrocarbon energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
8,7_7,What are the functions of lipids.,"The main biological functions of lipids include storing energy, as lipids may be broken down to yield large amounts of hydrocarbon energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
27,7_7,What are the functions of lipids.,"The main biological functions of lipids include storing energy, as lipids may be broken down to yield large amounts of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
54,7_7,What are the functions of lipids.,"The main biological functions of lipids include storing energy, as lipids may be broken down to yield large amounts of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,7_7,What are the functions of lipids.,Lipids are used in the structure of cell membranes.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
37,7_7,What are the functions of lipids.,Lipids are used in the structure of cell membranes.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,random answer,
44,7_7,What are the functions of lipids.,Lipids are the main structural components of the body.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,7_7,What are the functions of lipids.,Lipids are the main structural components of the body.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
59,7_7,What are the functions of lipids.,lipids are the main components of the human body's lipid system and the,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,malformed answer,
38,7_7,What are the functions of lipids.,lipids are the main components of the human body's lipid system and the,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,malformed answer,
12,7_9,What is the most common lipid?,Lipid is the most common lipid.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,true,false,correct answer,
43,7_9,What is the most common lipid?,Lipid is the most common lipid.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,correct answer,
28,7_9,What is the most common lipid?,"The most commonly occurring class of lipids are triglycerides, which are fats and oils.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,7_9,What is the most common lipid?,"The most commonly occurring class of lipids are triglycerides, which are fats and oils.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
39,7_9,What is the most common lipid?,"The most common class of lipids are triglycerides, which are fats and oils.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
54,7_9,What is the most common lipid?,"The most common class of lipids are triglycerides, which are fats and oils.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
43,7_9,What is the most common lipid?,the most commonly occurring class of lipids are triglycerides,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
14,7_9,What is the most common lipid?,the most commonly occurring class of lipids are triglycerides,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
15,7_9,What is the most common lipid?,Lipid is the most common type of lipid.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,correct answer,
44,7_9,What is the most common lipid?,Lipid is the most common type of lipid.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,good,false,false,random answer,
17,70_1,What is solar energy?,Solar energy is the energy produced by the Sun.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,70_1,What is solar energy?,Solar energy is the energy produced by the Sun.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
22,70_1,What is solar energy?,"Solar energy, also known as green energy, is the practice of using the sun to generate electricity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,good one,false,false,,
20,70_1,What is solar energy?,"Solar energy, also known as green energy, is the practice of using the sun to generate electricity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
78,70_1,What is solar energy?,Solar energy is the potential of a solar system to handle large amounts of solar energy. Such systems may be able to handle large amounts of,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
24,70_1,What is solar energy?,Solar energy is the potential of a solar system to handle large amounts of solar energy. Such systems may be able to handle large amounts of,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
20,70_1,What is solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,70_1,What is solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
8,70_1,What is solar energy?,Solar energy is the production of electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,70_1,What is solar energy?,Solar energy is the production of electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
98,70_1,What is solar energy?,Solar energy is the process of converting sunlight into electrical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
32,70_1,What is solar energy?,Solar energy is the process of converting sunlight into electrical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
94,70_1,What is solar energy?,Solar energy is the energy from the sun.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,70_1,What is solar energy?,Solar energy is the energy from the sun.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
107,70_1,What is solar energy?,Solar energy is the use of the sun's energy to produce electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
41,70_1,What is solar energy?,Solar energy is the use of the sun's energy to produce electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
72,70_1,What is solar energy?,s solar energy is the process of producing electricity by a photovoltaic system,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
30,70_1,What is solar energy?,s solar energy is the process of producing electricity by a photovoltaic system,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
13,70_1,What is solar energy?,Solar energy is the process of converting sunlight into electrical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
7,70_1,What is solar energy?,Solar energy is the process of converting sunlight into electrical energy.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
21,70_1,What is solar energy?,s solar energy is the process of producing electricity by a photovoltaic system,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
12,70_1,What is solar energy?,s solar energy is the process of producing electricity by a photovoltaic system,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
10,70_1,What is solar energy?,Solar energy is the energy from the sun.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
42,70_1,What is solar energy?,Solar energy is the energy from the sun.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,70_1,What is solar energy?,"Solar energy, also known as green energy, is the practice of using the sun to generate electricity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
5,70_1,What is solar energy?,"Solar energy, also known as green energy, is the practice of using the sun to generate electricity.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
10,70_1,What is solar energy?,Solar energy is the use of the sun's energy to produce electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,70_1,What is solar energy?,Solar energy is the use of the sun's energy to produce electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
23,70_1,What is solar energy?,Solar energy is the potential of a solar system to handle large amounts of solar energy. Such systems may be able to handle large amounts of,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,,
59,70_1,What is solar energy?,Solar energy is the potential of a solar system to handle large amounts of solar energy. Such systems may be able to handle large amounts of,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
19,70_1,What is solar energy?,Solar energy is the energy produced by the Sun.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,70_1,What is solar energy?,Solar energy is the energy produced by the Sun.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,70_1,What is solar energy?,Solar energy is the production of electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,70_1,What is solar energy?,Solar energy is the production of electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,70_1,What is solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,70_1,What is solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
43,70_10,Can solar energy be used to power cars?,Solar power can be used to power cars.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,70_10,Can solar energy be used to power cars?,Solar power can be used to power cars.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,70_10,Can solar energy be used to power cars?,"Solar power can be used to power cars. The sun's energy is collected by using solar panels, and this energy is used for fueling the deep cycle batteries that run the car's motor.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
9,70_10,Can solar energy be used to power cars?,"Solar power can be used to power cars. The sun's energy is collected by using solar panels, and this energy is used for fueling the deep cycle batteries that run the car's motor.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
30,70_10,Can solar energy be used to power cars?,A solar vehicle is an electric vehicle powered completely or significantly by direct solar energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
19,70_10,Can solar energy be used to power cars?,A solar vehicle is an electric vehicle powered completely or significantly by direct solar energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,70_10,Can solar energy be used to power cars?,"yes, solar energy is used in cars",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
8,70_10,Can solar energy be used to power cars?,"yes, solar energy is used in cars",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
14,70_10,Can solar energy be used to power cars?,Solar energy can be used to power cars.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
3,70_10,Can solar energy be used to power cars?,Solar energy can be used to power cars.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,70_2,What are the main uses of solar energy?,Solar energy is used to generate electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
70,70_2,What are the main uses of solar energy?,Solar energy is used to generate electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
7,70_2,What are the main uses of solar energy?,The main uses of solar energy are as a source of heat and as a source of electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,good one,false,false,,
34,70_2,What are the main uses of solar energy?,The main uses of solar energy are as a source of heat and as a source of electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
30,70_2,What are the main uses of solar energy?,Solar energy is mainly used to generate electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
40,70_2,What are the main uses of solar energy?,Solar energy is mainly used to generate electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,confusing answer,
11,70_2,What are the main uses of solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,good one,false,false,,
57,70_2,What are the main uses of solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
100,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun's rays.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun's rays.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
10,70_2,What are the main uses of solar energy?,"The main uses of solar energy are energy storage, power generation, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,confusing answer,
47,70_2,What are the main uses of solar energy?,"The main uses of solar energy are energy storage, power generation, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,confusing answer,
18,70_2,What are the main uses of solar energy?," Solar energy is used to heat water, cook food, and power homes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,70_2,What are the main uses of solar energy?," Solar energy is used to heat water, cook food, and power homes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,random answer,
9,70_2,What are the main uses of solar energy?,"The main uses of solar energy are heating, cooling, and power generation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,70_2,What are the main uses of solar energy?,"The main uses of solar energy are heating, cooling, and power generation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
11,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
19,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
84,70_2,What are the main uses of solar energy?,"The main uses of solar energy are to generate electricity, heat, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,70_2,What are the main uses of solar energy?,"The main uses of solar energy are to generate electricity, heat, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
101,70_2,What are the main uses of solar energy?,The main uses of solar energy are as a source of heat and as a source of electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
112,70_2,What are the main uses of solar energy?,The main uses of solar energy are as a source of heat and as a source of electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,70_2,What are the main uses of solar energy?," Solar energy is used to heat water, cook food, and power homes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,70_2,What are the main uses of solar energy?," Solar energy is used to heat water, cook food, and power homes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,70_2,What are the main uses of solar energy?,"The main uses of solar energy are energy storage, power generation, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,70_2,What are the main uses of solar energy?,"The main uses of solar energy are energy storage, power generation, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
9,70_2,What are the main uses of solar energy?,"The main uses of solar energy are to generate electricity, heat, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,70_2,What are the main uses of solar energy?,"The main uses of solar energy are to generate electricity, heat, and transportation.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun's rays.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
20,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun's rays.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,NICE,false,false,,
12,70_2,What are the main uses of solar energy?,Solar energy is mainly used to generate electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
14,70_2,What are the main uses of solar energy?,Solar energy is mainly used to generate electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
41,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
32,70_2,What are the main uses of solar energy?,Solar energy is mainly used to produce electricity from the sun.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
13,70_2,What are the main uses of solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
24,70_2,What are the main uses of solar energy?,Solar energy is the use of the sun's energy to generate electricity.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,70_2,What are the main uses of solar energy?,"The main uses of solar energy are heating, cooling, and power generation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
12,70_2,What are the main uses of solar energy?,"The main uses of solar energy are heating, cooling, and power generation.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,70_2,What are the main uses of solar energy?,Solar energy is used to generate electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,70_2,What are the main uses of solar energy?,Solar energy is used to generate electricity.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
17,70_4,What are advantages of solar energy?,There are two main advantages of solar energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
10,70_4,What are advantages of solar energy?,There are two main advantages of solar energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,correct answer,
12,70_4,What are advantages of solar energy?,"Solar energy is cleaner, more efficient and reduces environmental impact than other forms of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
64,70_4,What are advantages of solar energy?,"Solar energy is cleaner, more efficient and reduces environmental impact than other forms of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
95,70_4,What are advantages of solar energy?,The advantages of solar energy include:,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,correct answer,
13,70_4,What are advantages of solar energy?,The advantages of solar energy include:,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,correct answer,
85,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and oil, and produces less greenhouse gas emissions than coal, natural gas, and oil.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,random answer,
113,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and oil, and produces less greenhouse gas emissions than coal, natural gas, and oil.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
114,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, and reduces the amount of greenhouse gases released into the atmosphere.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
7,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, and reduces the amount of greenhouse gases released into the atmosphere.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
8,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power, and produces less greenhouse gas emissions than coal, natural gas, and nuclear power.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
14,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power, and produces less greenhouse gas emissions than coal, natural gas, and nuclear power.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,random answer,
8,70_4,What are advantages of solar energy?," Solar energy has many advantages. It is a renewable source of energy, it is free, and it is environmentally friendly.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,good one,false,false,,
9,70_4,What are advantages of solar energy?," Solar energy has many advantages. It is a renewable source of energy, it is free, and it is environmentally friendly.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
102,70_4,What are advantages of solar energy?,Advantages of solar energy include a lower cost of energy than fossil fuels.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,70_4,What are advantages of solar energy?,Advantages of solar energy include a lower cost of energy than fossil fuels.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
99,70_4,What are advantages of solar energy?,Solar energy is cleaner than coal and emits less greenhouse gases than coal.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
14,70_4,What are advantages of solar energy?,Solar energy is cleaner than coal and emits less greenhouse gases than coal.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
28,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, natural gas, and nuclear power plants.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,confusing answer,
7,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, natural gas, and nuclear power plants.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,confusing answer,
16,70_4,What are advantages of solar energy?,The advantages of solar energy include: Low operating and maintenance costs Once the panels are installed. Environmentally friendly source of renewable energy. Independence from utility companies can either reduce/eliminate utility costs or serve as another income stream to the household.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,random answer,
19,70_4,What are advantages of solar energy?,The advantages of solar energy include: Low operating and maintenance costs Once the panels are installed. Environmentally friendly source of renewable energy. Independence from utility companies can either reduce/eliminate utility costs or serve as another income stream to the household.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
71,70_4,What are advantages of solar energy?,Solar energy is cleaner than coal and emits less greenhouse gases than coal.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
18,70_4,What are advantages of solar energy?,Solar energy is cleaner than coal and emits less greenhouse gases than coal.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
30,70_4,What are advantages of solar energy?,The advantages of solar energy include: Low operating and maintenance costs Once the panels are installed. Environmentally friendly source of renewable energy. Independence from utility companies can either reduce/eliminate utility costs or serve as another income stream to the household.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
21,70_4,What are advantages of solar energy?,The advantages of solar energy include: Low operating and maintenance costs Once the panels are installed. Environmentally friendly source of renewable energy. Independence from utility companies can either reduce/eliminate utility costs or serve as another income stream to the household.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
7,70_4,What are advantages of solar energy?,Advantages of solar energy include a lower cost of energy than fossil fuels.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,70_4,What are advantages of solar energy?,Advantages of solar energy include a lower cost of energy than fossil fuels.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,70_4,What are advantages of solar energy?,There are two main advantages of solar energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
24,70_4,What are advantages of solar energy?,There are two main advantages of solar energy.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,The answer doesn't state what the advantages are.,false,true,,
3,70_4,What are advantages of solar energy?," Solar energy has many advantages. It is a renewable source of energy, it is free, and it is environmentally friendly.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
30,70_4,What are advantages of solar energy?," Solar energy has many advantages. It is a renewable source of energy, it is free, and it is environmentally friendly.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,70_4,What are advantages of solar energy?,"Solar energy is cleaner, more efficient and reduces environmental impact than other forms of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,70_4,What are advantages of solar energy?,"Solar energy is cleaner, more efficient and reduces environmental impact than other forms of energy.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
31,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and oil, and produces less greenhouse gas emissions than coal, natural gas, and oil.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
11,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and oil, and produces less greenhouse gas emissions than coal, natural gas, and oil.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
3,70_4,What are advantages of solar energy?,The advantages of solar energy include:,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,70_4,What are advantages of solar energy?,The advantages of solar energy include:,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,good,false,false,,
17,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, natural gas, and nuclear power plants.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, natural gas, and nuclear power plants.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
41,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, and reduces the amount of greenhouse gases released into the atmosphere.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power. It produces less greenhouse gas emissions than coal, and reduces the amount of greenhouse gases released into the atmosphere.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
12,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power, and produces less greenhouse gas emissions than coal, natural gas, and nuclear power.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
13,70_4,What are advantages of solar energy?,"Solar energy is cleaner than coal, natural gas, and nuclear power, and produces less greenhouse gas emissions than coal, natural gas, and nuclear power.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
12,70_5,What is the cost of solar power?,"The cost of solar power varies widely, from a few hundred dollars to several hundred dollars a month.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,positive one,false,false,,
10,70_5,What is the cost of solar power?,"The cost of solar power varies widely, from a few hundred dollars to several hundred dollars a month.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
42,70_5,What is the cost of solar power?,"The cost of solar power depends largely on the design and location of the system; typically, home installations range from 3 to 7 kilowatts, ranging in price from $18,000 to $40,000 for an outright purchase.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,confusing answer,
37,70_5,What is the cost of solar power?,"The cost of solar power depends largely on the design and location of the system; typically, home installations range from 3 to 7 kilowatts, ranging in price from $18,000 to $40,000 for an outright purchase.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,confusing answer,
6,70_5,What is the cost of solar power?,The average cost of solar power in the United States is about $1 per watt.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
44,70_5,What is the cost of solar power?,The average cost of solar power in the United States is about $1 per watt.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
25,70_5,What is the cost of solar power?,"with a full-length system, the cost of solar power can range from",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,correct answer,
14,70_5,What is the cost of solar power?,"with a full-length system, the cost of solar power can range from",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
16,70_5,What is the cost of solar power?,"with a full-length system, the cost of solar power can range from",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
5,70_5,What is the cost of solar power?,"with a full-length system, the cost of solar power can range from",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
28,70_5,What is the cost of solar power?,"The cost of solar power depends largely on the design and location of the system; typically, home installations range from 3 to 7 kilowatts, ranging in price from $18,000 to $40,000 for an outright purchase.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,70_5,What is the cost of solar power?,"The cost of solar power depends largely on the design and location of the system; typically, home installations range from 3 to 7 kilowatts, ranging in price from $18,000 to $40,000 for an outright purchase.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,GOOD,false,false,,
6,70_5,What is the cost of solar power?,"The cost of solar power varies widely, from a few hundred dollars to several hundred dollars a month.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,70_5,What is the cost of solar power?,"The cost of solar power varies widely, from a few hundred dollars to several hundred dollars a month.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
24,70_5,What is the cost of solar power?,The average cost of solar power in the United States is about $1 per watt.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
21,70_5,What is the cost of solar power?,The average cost of solar power in the United States is about $1 per watt.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
56,70_6,How is solar power being used in rural Africa?,Solar energy is being used in rural Africa to power homes and cook food.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,70_6,How is solar power being used in rural Africa?,Solar energy is being used in rural Africa to power homes and cook food.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,70_6,How is solar power being used in rural Africa?,Solar power is being used in rural Africa to generate electricity.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,70_6,How is solar power being used in rural Africa?,Solar power is being used in rural Africa to generate electricity.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
22,70_6,How is solar power being used in rural Africa?,The use of solar energy in rural areas across sub-Saharan Africa has increased over the years.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
12,70_6,How is solar power being used in rural Africa?,The use of solar energy in rural areas across sub-Saharan Africa has increased over the years.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
16,70_6,How is solar power being used in rural Africa?,Another use for solar energy that has gained momentum in rural African households is that of solar cooking.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
3,70_6,How is solar power being used in rural Africa?,Another use for solar energy that has gained momentum in rural African households is that of solar cooking.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
7,70_6,How is solar power being used in rural Africa?,Another use for solar energy that has gained momentum in rural African households (as well as some urban areas) is that of solar cooking.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
9,70_6,How is solar power being used in rural Africa?,Another use for solar energy that has gained momentum in rural African households (as well as some urban areas) is that of solar cooking.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
8,70_6,How is solar power being used in rural Africa?,the use of solar energy in rural africa has increased over the years.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
71,70_6,How is solar power being used in rural Africa?,the use of solar energy in rural africa has increased over the years.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,false,true,,
12,70_8,How is solar energy used in architecture?,Solar energy is used in architecture.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
14,70_8,How is solar energy used in architecture?,Solar energy is used in architecture.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,,
30,70_8,How is solar energy used in architecture?,Solar architecture is an architectural approach that takes in account the Sun to harness clean and renewable solar power.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
4,70_8,How is solar energy used in architecture?,Solar architecture is an architectural approach that takes in account the Sun to harness clean and renewable solar power.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
19,70_8,How is solar energy used in architecture?,Solar architecture is an architectural approach that takes in the Sun to harness clean and renewable solar power.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,false,,false,true,,
3,70_8,How is solar energy used in architecture?,Solar architecture is an architectural approach that takes in the Sun to harness clean and renewable solar power.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,71_10,Where do blue whales live?,Blue whales live in all oceans of the world. They feed in high latitudes and migrate to the tropics to breed and give birth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,71_10,Where do blue whales live?,Blue whales live in all oceans of the world. They feed in high latitudes and migrate to the tropics to breed and give birth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,71_10,Where do blue whales live?,blue whales live in all oceans of the world,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
7,71_10,Where do blue whales live?,blue whales live in all oceans of the world,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
12,71_10,Where do blue whales live?,"Blue whales are found in the Pacific and Atlantic Oceans, the Gulf of Saint Lawrence, and the Indian Oceans.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
5,71_10,Where do blue whales live?,"Blue whales are found in the Pacific and Atlantic Oceans, the Gulf of Saint Lawrence, and the Indian Oceans.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
6,71_10,Where do blue whales live?,Blue whales inhabit most of the world's major oceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,71_10,Where do blue whales live?,Blue whales inhabit most of the world's major oceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
23,71_11,What do blue whales eat?,"Blue whales feed almost exclusively on krill, though they also take small numbers of copepods.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,71_11,What do blue whales eat?,"Blue whales feed almost exclusively on krill, though they also take small numbers of copepods.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,71_11,What do blue whales eat?,Blue whales feed on zooplankton (especially krill).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,71_11,What do blue whales eat?,Blue whales feed on zooplankton (especially krill).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
19,71_11,What do blue whales eat?,Blue whales feed on zooplankton (especially krill). It’s believed that blue whales can eat up to 4 tons of krill a day!,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
4,71_11,What do blue whales eat?,Blue whales feed on zooplankton (especially krill). It’s believed that blue whales can eat up to 4 tons of krill a day!,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
8,71_3,How many legs do mammals have?,"Mammals have 5 legs. Common definitions seem to include them as limbs, giving many mammals 5 limbs instead of 4.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
23,71_3,How many legs do mammals have?,"Mammals have 5 legs. Common definitions seem to include them as limbs, giving many mammals 5 limbs instead of 4.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,71_3,How many legs do mammals have?,Mammals have four legs.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,71_3,How many legs do mammals have?,Mammals have four legs.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
30,71_3,How many legs do mammals have?,Mammals have 4 legs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,71_3,How many legs do mammals have?,Mammals have 4 legs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,71_4,What is the largest mammal on land?,The largest land mammal extant today is the African bush elephant.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,71_4,What is the largest mammal on land?,The largest land mammal extant today is the African bush elephant.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,71_4,What is the largest mammal on land?,The largest mammal extant today is the African bush elephant.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,71_4,What is the largest mammal on land?,The largest mammal extant today is the African bush elephant.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,71_4,What is the largest mammal on land?,"The largest mammal known was long considered to be Paraceratherium orgosensis, a rhino relative thought to have stood up to 4.8 m (15.7 ft) tall, measured over 7.4 m (24.3 ft) long and may have weighed about 17 tonnes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
42,71_4,What is the largest mammal on land?,"The largest mammal known was long considered to be Paraceratherium orgosensis, a rhino relative thought to have stood up to 4.8 m (15.7 ft) tall, measured over 7.4 m (24.3 ft) long and may have weighed about 17 tonnes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
20,71_4,What is the largest mammal on land?,The largest land mammal today is the African bush elephant.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,71_4,What is the largest mammal on land?,The largest land mammal today is the African bush elephant.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,71_4,What is the largest mammal on land?,The elephant is the largest mammal on land.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,71_4,What is the largest mammal on land?,The elephant is the largest mammal on land.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,71_8,Tell me about Blue whales.,Blue whales are the largest of the baleen whales.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
3,71_8,Tell me about Blue whales.,Blue whales are the largest of the baleen whales.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,71_8,Tell me about Blue whales.,Blue whales are the largest animals on earth. They can reach up to 100 feet long and weigh up to 200 tons.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,71_8,Tell me about Blue whales.,Blue whales are the largest animals on earth. They can reach up to 100 feet long and weigh up to 200 tons.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,71_8,Tell me about Blue whales.,Blue whales are the largest cetaceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
3,71_8,Tell me about Blue whales.,Blue whales are the largest cetaceans.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
17,71_8,Tell me about Blue whales.,Blue whales are the largest and most endangered whales in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
3,71_8,Tell me about Blue whales.,Blue whales are the largest and most endangered whales in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,71_8,Tell me about Blue whales.,Blue whales are the largest mammal to ever walk the Earth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
7,71_8,Tell me about Blue whales.,Blue whales are the largest mammal to ever walk the Earth.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
9,71_8,Tell me about Blue whales.,Blue whales are the largest mammals in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,71_8,Tell me about Blue whales.,Blue whales are the largest mammals in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
11,71_8,Tell me about Blue whales.,Blue whales are the largest whales in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
9,71_8,Tell me about Blue whales.,Blue whales are the largest whales in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,71_8,Tell me about Blue whales.,"Blue whales are one of the largest mammals in the world, and one of the most endangered.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,71_8,Tell me about Blue whales.,"Blue whales are one of the largest mammals in the world, and one of the most endangered.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,72_5,How does the Spanish Christmas Lottery drawing work?,"The Spanish Christmas Lottery works more like a raffle than a lottery. Each ticket has a number between 00000 and 99999. When the draw takes place, players win a prize if the numbers on their ticket match those on a ticket drawn from the drum.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
6,72_5,How does the Spanish Christmas Lottery drawing work?,"The Spanish Christmas Lottery works more like a raffle than a lottery. Each ticket has a number between 00000 and 99999. When the draw takes place, players win a prize if the numbers on their ticket match those on a ticket drawn from the drum.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,72_5,How does the Spanish Christmas Lottery drawing work?,The Spanish Christmas Lottery works more like a raffle than aJack. Each ticket has a number between 00000 and 99999.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,72_5,How does the Spanish Christmas Lottery drawing work?,The Spanish Christmas Lottery works more like a raffle than aJack. Each ticket has a number between 00000 and 99999.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,72_5,How does the Spanish Christmas Lottery drawing work?,"The Spanish Christmas Lottery works more like a raffle than a lottery. There are no lottery balls; instead, there are two huge prizes that contain all the purchased tickets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
13,72_5,How does the Spanish Christmas Lottery drawing work?,"The Spanish Christmas Lottery works more like a raffle than a lottery. There are no lottery balls; instead, there are two huge prizes that contain all the purchased tickets.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
31,73_4,What were Ching Shih's code of laws?,"A woman in command of a huge pirate fleet, Ching Shih had her work cut out for her. The code was strict, and stated that any pirate giving his own orders or disobeying those of a superior was to be beheaded on the spot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
6,73_4,What were Ching Shih's code of laws?,"A woman in command of a huge pirate fleet, Ching Shih had her work cut out for her. The code was strict, and stated that any pirate giving his own orders or disobeying those of a superior was to be beheaded on the spot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,false,,false,true,,
23,73_4,What were Ching Shih's code of laws?,"The code was strict, and stated that any pirate giving his own orders or disobeying those of a superior was to be beheaded on the spot.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,73_4,What were Ching Shih's code of laws?,"The code was strict, and stated that any pirate giving his own orders or disobeying those of a superior was to be beheaded on the spot.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,73_4,What were Ching Shih's code of laws?,"The code was strict, and stated that any pirate giving his own orders or disobeying those of a superior was to beheaded on the spot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
25,73_4,What were Ching Shih's code of laws?,"The code was strict, and stated that any pirate giving his own orders or disobeying those of a superior was to beheaded on the spot.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,73_6,Who was Anne Bonny?,Anne Bonny was an 18th-century Irish female pirate.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
10,73_6,Who was Anne Bonny?,Anne Bonny was an 18th-century Irish female pirate.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,73_6,Who was Anne Bonny?,Anne Bonny was a pirate who lived in the 18th century.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,73_6,Who was Anne Bonny?,Anne Bonny was a pirate who lived in the 18th century.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,73_6,Who was Anne Bonny?,Anne Bonny was an Irish pirate operating in the Caribbean.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,73_6,Who was Anne Bonny?,Anne Bonny was an Irish pirate operating in the Caribbean.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
23,73_7,What was Anne Bonny famous for?,Anne Bonny was an Irish woman and one of the most famous female pirates during the 18th century era that is today most commonly known as The Golden Age of Pirates.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,73_7,What was Anne Bonny famous for?,Anne Bonny was an Irish woman and one of the most famous female pirates during the 18th century era that is today most commonly known as The Golden Age of Pirates.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
15,73_7,What was Anne Bonny famous for?,Anne Bonny was famous for being a pirate.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
20,73_7,What was Anne Bonny famous for?,Anne Bonny was famous for being a pirate.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,73_7,What was Anne Bonny famous for?,"Anne Bonny - Famous Female Pirate Famous Pirates Famous Pirates Pirates History Pirates Facts You're here: Home Famous Pirates Anne Bonny Home Famous Pirates Anne Bonny entityLocation2 Anne Bonny - Female Pirate entityLocation1 Anne Bonny (born on March 8, 1702, died possibly on April 1782) was an Irish woman and one of the most famous female pirates during the 18th century era that is today most commonly known as The Golden Age of Pirates .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
50,73_7,What was Anne Bonny famous for?,"Anne Bonny - Famous Female Pirate Famous Pirates Famous Pirates Pirates History Pirates Facts You're here: Home Famous Pirates Anne Bonny Home Famous Pirates Anne Bonny entityLocation2 Anne Bonny - Female Pirate entityLocation1 Anne Bonny (born on March 8, 1702, died possibly on April 1782) was an Irish woman and one of the most famous female pirates during the 18th century era that is today most commonly known as The Golden Age of Pirates .",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,"It answers the question, but looks more like a copy/paste from an article.",true,false,,
13,73_7,What was Anne Bonny famous for?,died possibly on april 1782 ) was an irish woman and one of the most famous female pirates during the 18th century era that is today most commonly known as the golden age of pirates.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
6,73_7,What was Anne Bonny famous for?,died possibly on april 1782 ) was an irish woman and one of the most famous female pirates during the 18th century era that is today most commonly known as the golden age of pirates.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
6,73_7,What was Anne Bonny famous for?,anne bonny was one of the most famous female pirates during the 18th century,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
3,73_7,What was Anne Bonny famous for?,anne bonny was one of the most famous female pirates during the 18th century,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
10,74_10,How long can Tesla car batteries last?,Tesla's Model 3 battery module should last 300k to 500k miles. Current battery modules should last 300k to 500k miles (1500 cycles).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
3,74_10,How long can Tesla car batteries last?,Tesla's Model 3 battery module should last 300k to 500k miles. Current battery modules should last 300k to 500k miles (1500 cycles).,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
20,74_10,How long can Tesla car batteries last?,Tesla car batteries should last 300k to 500k miles. Current battery modules should last 300k to 500k miles (1500 cycles).,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
11,74_10,How long can Tesla car batteries last?,Tesla car batteries should last 300k to 500k miles. Current battery modules should last 300k to 500k miles (1500 cycles).,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
42,74_10,How long can Tesla car batteries last?,"Tesla's Model 3 battery modules should last between 300,000 miles and 500,000 miles: Model 3 drive unit & body is designed like a commercial truck for a million mile life.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
49,74_10,How long can Tesla car batteries last?,"Tesla's Model 3 battery modules should last between 300,000 miles and 500,000 miles: Model 3 drive unit & body is designed like a commercial truck for a million mile life.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
17,74_11,Tell me more about autopilot in Tesla cars.,Autopilot is a feature in Teslas that allows the driver to take control of the vehicle.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,74_11,Tell me more about autopilot in Tesla cars.,Autopilot is a feature in Teslas that allows the driver to take control of the vehicle.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
25,74_11,Tell me more about autopilot in Tesla cars.,"Tesla's semi-automatic driving system, called AutoPilot, uses computers to take over control of the Tesla Model S sedan when the driver is not present.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,74_11,Tell me more about autopilot in Tesla cars.,"Tesla's semi-automatic driving system, called AutoPilot, uses computers to take over control of the Tesla Model S sedan when the driver is not present.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
33,74_11,Tell me more about autopilot in Tesla cars.,Autopilot is a feature that allows the car to drive itself.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
69,74_11,Tell me more about autopilot in Tesla cars.,Autopilot is a feature that allows the car to drive itself.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
8,74_2,Tell me more about Tesla the car company.,"Tesla is an American electric car company founded in Palo Alto, California in 1994.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
6,74_2,Tell me more about Tesla the car company.,"Tesla is an American electric car company founded in Palo Alto, California in 1994.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
28,74_2,Tell me more about Tesla the car company.,"Tesla Motors is an American electric vehicle manufacturer, headquartered in Palo Alto, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
27,74_2,Tell me more about Tesla the car company.,"Tesla Motors is an American electric vehicle manufacturer, headquartered in Palo Alto, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
34,74_2,Tell me more about Tesla the car company.,"Tesla Motors is an American electric car company based in Palo Alto, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,74_2,Tell me more about Tesla the car company.,"Tesla Motors is an American electric car company based in Palo Alto, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
18,74_2,Tell me more about Tesla the car company.,"Tesla is an American electric car company based in Palo Alto, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
12,74_2,Tell me more about Tesla the car company.,"Tesla is an American electric car company based in Palo Alto, California.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
14,74_2,Tell me more about Tesla the car company.,Tesla Motors is an American electric vehicle manufacturer.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
11,74_2,Tell me more about Tesla the car company.,Tesla Motors is an American electric vehicle manufacturer.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
14,74_4,What Tesla car models are available?,"Tesla Motors currently produces five vehicles: the Model S, Model X, Model 3, Model S Plus, and Model X Plus.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,74_4,What Tesla car models are available?,"Tesla Motors currently produces five vehicles: the Model S, Model X, Model 3, Model S Plus, and Model X Plus.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
22,74_4,What Tesla car models are available?,"There are four models available for Tesla's Model S, which are mounted on top of the Tesla Model S.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
4,74_4,What Tesla car models are available?,"There are four models available for Tesla's Model S, which are mounted on top of the Tesla Model S.",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
10,74_4,What Tesla car models are available?,"Tesla vehicles include the Model S, Model X, and Model 3.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
111,74_4,What Tesla car models are available?,"Tesla vehicles include the Model S, Model X, and Model 3.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
14,74_4,What Tesla car models are available?,"The Tesla Model S, Model X, and Model 3 are all available.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,74_4,What Tesla car models are available?,"The Tesla Model S, Model X, and Model 3 are all available.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,74_4,What Tesla car models are available?,"Tesla's vehicles include the Model S, Model X, Model 3, and Model S Plus.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
6,74_4,What Tesla car models are available?,"Tesla's vehicles include the Model S, Model X, Model 3, and Model S Plus.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
14,74_4,What Tesla car models are available?,"Tesla has three models: the Model S, Model X, and Model 3.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
3,74_4,What Tesla car models are available?,"Tesla has three models: the Model S, Model X, and Model 3.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,74_4,What Tesla car models are available?,"Tesla Motors has three vehicle models: the Model S, the Model X, and the Model Y Roadster.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,74_4,What Tesla car models are available?,"Tesla Motors has three vehicle models: the Model S, the Model X, and the Model Y Roadster.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
13,74_4,What Tesla car models are available?,"Tesla's Model S, Model X, and Model 3 are all electric vehicles.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
3,74_4,What Tesla car models are available?,"Tesla's Model S, Model X, and Model 3 are all electric vehicles.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
6,74_4,What Tesla car models are available?,"Tesla Motors' product lineup includes the Tesla Roadster, the Tesla Model S, the Tesla Model X, the Tesla T, and the Tesla T in Crest.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,74_4,What Tesla car models are available?,"Tesla Motors' product lineup includes the Tesla Roadster, the Tesla Model S, the Tesla Model X, the Tesla T, and the Tesla T in Crest.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,74_4,What Tesla car models are available?,"As of January 2019, Tesla offers three car models: the Model S, Model X and Model 3.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,74_4,What Tesla car models are available?,"As of January 2019, Tesla offers three car models: the Model S, Model X and Model 3.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
16,74_4,What Tesla car models are available?," Tesla offers three models: the Model S, the Model X, and the Model 3.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,74_4,What Tesla car models are available?," Tesla offers three models: the Model S, the Model X, and the Model 3.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,74_5,What is the best selling Tesla car model?,The Model 3 is the best selling electric car in the U.S.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
13,74_5,What is the best selling Tesla car model?,The Model 3 is the best selling electric car in the U.S.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
22,74_5,What is the best selling Tesla car model?,"Tesla's Model S is the best-selling electric vehicle in the US during the first half of this year, according to estimates from the electric-vehicle website InsideEVs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,74_5,What is the best selling Tesla car model?,"Tesla's Model S is the best-selling electric vehicle in the US during the first half of this year, according to estimates from the electric-vehicle website InsideEVs.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
23,74_5,What is the best selling Tesla car model?,The Tesla Model 3 is the best selling electric vehicle in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
7,74_5,What is the best selling Tesla car model?,The Tesla Model 3 is the best selling electric vehicle in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
34,74_5,What is the best selling Tesla car model?,"The Tesla Model S was the best-selling electric vehicle in the US during the first half of 2019, according to estimates from the electric-vehicle website InsideEVs.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,74_5,What is the best selling Tesla car model?,"The Tesla Model S was the best-selling electric vehicle in the US during the first half of 2019, according to estimates from the electric-vehicle website InsideEVs.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
36,75_3,What was the importance of turkey in native cultures?,"Native Americans first domesticated turkeys around 800 B.C., Turkeys weren’t initially used for their meat, but rather their feathers.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,75_3,What was the importance of turkey in native cultures?,"Native Americans first domesticated turkeys around 800 B.C., Turkeys weren’t initially used for their meat, but rather their feathers.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
6,75_3,What was the importance of turkey in native cultures?,"Turkeys were initially raised for their feathers; however, around 1100 A.D., Native Americans began to rely on these birds as a food source.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
5,75_3,What was the importance of turkey in native cultures?,"Turkeys were initially raised for their feathers; however, around 1100 A.D., Native Americans began to rely on these birds as a food source.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,75_3,What was the importance of turkey in native cultures?,Native Americans have hunted wild turkey for its meat as early as 1000 A.D. They made turkey whistles out of turkey wing bones.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
31,75_3,What was the importance of turkey in native cultures?,Native Americans have hunted wild turkey for its meat as early as 1000 A.D. They made turkey whistles out of turkey wing bones.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,75_4,When and how were turkeys domesticated?,Native Americans first domesticated turkeys around 800 B.C.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
21,75_4,When and how were turkeys domesticated?,Native Americans first domesticated turkeys around 800 B.C.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,75_4,When and how were turkeys domesticated?,"Around 800 B.C., Native Americans had already domesticated turkeys twice: first in south-central Mexico at around 800 B.C. and again in what is now the southwestern U.S.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
41,75_4,When and how were turkeys domesticated?,"Around 800 B.C., Native Americans had already domesticated turkeys twice: first in south-central Mexico at around 800 B.C. and again in what is now the southwestern U.S.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,false,,false,true,,
10,75_4,When and how were turkeys domesticated?,Native Americans had already domesticated turkeys twice: first in south-central Mexico at around 800 B.C. and again in what is now the southwestern U.S. at about 200 B.C.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
31,75_4,When and how were turkeys domesticated?,Native Americans had already domesticated turkeys twice: first in south-central Mexico at around 800 B.C. and again in what is now the southwestern U.S. at about 200 B.C.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,It doesn't state how they were domesticated.,false,true,,
19,75_5,Can turkeys fly?,"While the turkey you cook for Thanksgiving has never been airborne, wild turkeys can fly. Apparently not fast or high enough, however.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
109,75_5,Can turkeys fly?,"While the turkey you cook for Thanksgiving has never been airborne, wild turkeys can fly. Apparently not fast or high enough, however.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
16,75_5,Can turkeys fly?,"By Robert Roy Britt | October 27, 2012 05:43pm ET Share Tools MORE While the turkey you cook for Thanksgiving has never been airborne, wild turkeys can fly.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,,true,false,,
29,75_5,Can turkeys fly?,"By Robert Roy Britt | October 27, 2012 05:43pm ET Share Tools MORE While the turkey you cook for Thanksgiving has never been airborne, wild turkeys can fly.",simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,false,This looks more like a copy/paste than an answer.,true,false,,
5,75_5,Can turkeys fly?,"2012 05 : 43pm et share tools more while the turkey you cook for thanksgiving has never been airborne, wild turkeys can fly",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
63,75_5,Can turkeys fly?,"2012 05 : 43pm et share tools more while the turkey you cook for thanksgiving has never been airborne, wild turkeys can fly",rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
18,76_10,What is an example of foreshadowing?,"An example of foreshadowing is when a character in a story comments on the weather, and says, I think a storm is coming.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,76_10,What is an example of foreshadowing?,"An example of foreshadowing is when a character in a story comments on the weather, and says, I think a storm is coming.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
23,76_10,What is an example of foreshadowing?,foreshadowing is the foreshadowing of events that are to come in a particular,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
3,76_10,What is an example of foreshadowing?,foreshadowing is the foreshadowing of events that are to come in a particular,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
64,76_10,What is an example of foreshadowing?,An example of foreshadowing is when a character or event is foreshadowed.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
7,76_10,What is an example of foreshadowing?,An example of foreshadowing is when a character or event is foreshadowed.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
7,76_10,What is an example of foreshadowing?,Foreshadowing can provide readers with hints and a sense of anticipation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,76_10,What is an example of foreshadowing?,Foreshadowing can provide readers with hints and a sense of anticipation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
18,76_10,What is an example of foreshadowing?,"In a short story or novel, foreshadowing is a literary device that gets students acting like detectives, on the edge of their seats, and trying to guess what will happen next.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,76_10,What is an example of foreshadowing?,"In a short story or novel, foreshadowing is a literary device that gets students acting like detectives, on the edge of their seats, and trying to guess what will happen next.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
14,76_2,What is the difference between literary elements and literary devices?,Literary devices are literary devices that are used to convey literary concepts.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,,false,true,,
17,76_2,What is the difference between literary elements and literary devices?,Literary devices are literary devices that are used to convey literary concepts.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
11,76_2,What is the difference between literary elements and literary devices?,The difference between literary elements and literary devices is that the literary device is a literary device.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,76_2,What is the difference between literary elements and literary devices?,The difference between literary elements and literary devices is that the literary device is a literary device.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,76_2,What is the difference between literary elements and literary devices?,Literary devices are literary allusions that are used to convey meanings to the reader.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,false,,false,true,,
5,76_2,What is the difference between literary elements and literary devices?,Literary devices are literary allusions that are used to convey meanings to the reader.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
33,76_2,What is the difference between literary elements and literary devices?,Both literary elements and literary devices are literary devices.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,the answer does not clearly answer the question,false,true,,
23,76_2,What is the difference between literary elements and literary devices?,Both literary elements and literary devices are literary devices.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
14,76_2,What is the difference between literary elements and literary devices?,Literary elements and literary devices are defined as the use of literary elements and literary devices in the writing of texts.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
22,76_2,What is the difference between literary elements and literary devices?,Literary elements and literary devices are defined as the use of literary elements and literary devices in the writing of texts.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
58,76_2,What is the difference between literary elements and literary devices?,A literary device is a device that is used rhetorically or rhetorically in a written work. A literary device is a device that is used rhetorically or rhetorically in a written work.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,false,,true,false,,
4,76_2,What is the difference between literary elements and literary devices?,A literary device is a device that is used rhetorically or rhetorically in a written work. A literary device is a device that is used rhetorically or rhetorically in a written work.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
76,76_3,What is a literary genre?,"A genre is a group of words, phrases, or ideas that are used to convey a literary concept.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,the answer does not clearly answer the question,false,true,,
11,76_3,What is a literary genre?,"A genre is a group of words, phrases, or ideas that are used to convey a literary concept.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
22,76_3,What is a literary genre?,Genre is a category of literature.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
95,76_3,What is a literary genre?,Genre is a category of literature.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
5,76_3,What is a literary genre?,A literary genre is any representation of a specific literary medium.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,76_3,What is a literary genre?,A literary genre is any representation of a specific literary medium.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,76_3,What is a literary genre?,"A literary genre is a broad term that covers many different types of literature, including fiction, non-fiction, and criticism.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
17,76_3,What is a literary genre?,"A literary genre is a broad term that covers many different types of literature, including fiction, non-fiction, and criticism.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
27,76_5,What is a trope?,"A trope is a type of trope that is thought to be a metal trope or something. The term ""trope"" is a metal trope that is used to make noises and to",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,true,false,,
4,76_5,What is a trope?,"A trope is a type of trope that is thought to be a metal trope or something. The term ""trope"" is a metal trope that is used to make noises and to",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
19,76_5,What is a trope?,A trope in a novel is a stereotypical image of a character appearing in a novel.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,76_5,What is a trope?,A trope in a novel is a stereotypical image of a character appearing in a novel.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
4,76_5,What is a trope?,A trope is a fictional character or group of fictional characters.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
10,76_5,What is a trope?,A trope is a fictional character or group of fictional characters.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
9,76_5,What is a trope?,A trope is a literary device that is used to enhance the story.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,76_5,What is a trope?,A trope is a literary device that is used to enhance the story.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
9,76_5,What is a trope?,A trope is a recurring plot device in a comic book or film.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
6,76_5,What is a trope?,A trope is a recurring plot device in a comic book or film.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
71,77_1,What's the difference between soup and stew?,"Soup, loosely, is a liquid-based dish where ingredients like vegetables, meats or legumes (or any combination of the three) are boiled in water, stock or broth to meld and enhance the dish’s favors.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,false,the answer does not clearly answer the question by explaining the difference with stew,false,true,,
13,77_1,What's the difference between soup and stew?,"Soup, loosely, is a liquid-based dish where ingredients like vegetables, meats or legumes (or any combination of the three) are boiled in water, stock or broth to meld and enhance the dish’s favors.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
10,77_1,What's the difference between soup and stew?,Stir-fried or stew is a type of soup.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
28,77_1,What's the difference between soup and stew?,Stir-fried or stew is a type of soup.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
19,77_1,What's the difference between soup and stew?,"soup is a liquid-based dish where ingredients like vegetables, meats or legumes",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
5,77_1,What's the difference between soup and stew?,"soup is a liquid-based dish where ingredients like vegetables, meats or legumes",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
26,77_1,What's the difference between soup and stew?,Soup is a type of stew.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,INCOMPLETE,false,false,,
3,77_1,What's the difference between soup and stew?,Soup is a type of stew.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
4,77_10,What is the history of Irish stew?,Irish stew is said to have originated in the south of Ireland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
25,77_10,What is the history of Irish stew?,Irish stew is said to have originated in the south of Ireland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,NICE,false,false,,
13,77_10,What is the history of Irish stew?,Irish stew is a dish that has been around since the 16th century.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
4,77_10,What is the history of Irish stew?,Irish stew is a dish that has been around since the 16th century.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,77_10,What is the history of Irish stew?,Irish stew is a traditional Irish dish made from beef or lamb.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
11,77_10,What is the history of Irish stew?,Irish stew is a traditional Irish dish made from beef or lamb.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,good,false,false,,
12,77_10,What is the history of Irish stew?,Irish stew is a traditional Irish dish made from meat and potatoes.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
3,77_10,What is the history of Irish stew?,Irish stew is a traditional Irish dish made from meat and potatoes.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
90,77_10,What is the history of Irish stew?,Irish stew is a traditional Irish dish.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,,
13,77_10,What is the history of Irish stew?,Irish stew is a traditional Irish dish.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,GOOD,false,false,,
5,77_10,What is the history of Irish stew?,The origins of Irish stew are uncertain.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
12,77_10,What is the history of Irish stew?,The origins of Irish stew are uncertain.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
5,77_10,What is the history of Irish stew?,Irish stew is one of the most popular dishes in Ireland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
35,77_10,What is the history of Irish stew?,Irish stew is one of the most popular dishes in Ireland.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,NICE,false,false,,
14,77_10,What is the history of Irish stew?,"Irish stew is an Irish dish made from meat, usually lamb, and potatoes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
3,77_10,What is the history of Irish stew?,"Irish stew is an Irish dish made from meat, usually lamb, and potatoes.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
16,77_3,Is goulash a stew?,A traditional Hungarian Goulash is a soup or stew that is usually filled with tender beef and onions spiced with paprika.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
31,77_3,Is goulash a stew?,A traditional Hungarian Goulash is a soup or stew that is usually filled with tender beef and onions spiced with paprika.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,GOOD,false,false,,
31,77_3,Is goulash a stew?,Goulash is a cold-weather staple for us so we can talk about Hungary's fantastic beef dish called goulash.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
22,77_3,Is goulash a stew?,Goulash is a cold-weather staple for us so we can talk about Hungary's fantastic beef dish called goulash.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,It doesn't answer whether the meal is a stew or not.,false,true,,
13,77_3,Is goulash a stew?,Goulash is a traditional Hungarian stew.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
19,77_3,Is goulash a stew?,Goulash is a traditional Hungarian stew.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,good,false,false,,
11,77_3,Is goulash a stew?,"Goulash is a traditional Hungarian stew that is usually filled with potatoes, carrots, celery, and other vegetables.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,77_3,Is goulash a stew?,"Goulash is a traditional Hungarian stew that is usually filled with potatoes, carrots, celery, and other vegetables.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,GOOD,false,false,,
4,77_3,Is goulash a stew?,Goulash is a stew.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,77_3,Is goulash a stew?,Goulash is a stew.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
25,77_3,Is goulash a stew?,Goulash is a stew.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
21,77_3,Is goulash a stew?,Goulash is a stew.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,77_3,Is goulash a stew?,"Hungarian goulash is a traditional beef stew (or soup) with a rich paprika seasoned broth. This delicious dish is warm and comforting, perfect for a cold weather day.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
19,77_3,Is goulash a stew?,"Hungarian goulash is a traditional beef stew (or soup) with a rich paprika seasoned broth. This delicious dish is warm and comforting, perfect for a cold weather day.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,GOOD,false,false,,
26,77_8,Tell about Bigos stew.,Bigos is a traditional Hungarian stew made with meat and vegetables.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
16,77_8,Tell about Bigos stew.,Bigos is a traditional Hungarian stew made with meat and vegetables.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,GOOD,false,false,,
15,77_8,Tell about Bigos stew.," Bigos is a Polish stew made with sauerkraut, meat, and potatoes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,77_8,Tell about Bigos stew.," Bigos is a Polish stew made with sauerkraut, meat, and potatoes.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
22,77_8,Tell about Bigos stew.,"Bigos is a traditional Polish dish that originated in Medieval times. Sauerkraut, Kielbasa, Wild Mushrooms, Prunes, and spices are braised in red wine for hours to achieve this amazing comfort food.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
29,77_8,Tell about Bigos stew.,"Bigos is a traditional Polish dish that originated in Medieval times. Sauerkraut, Kielbasa, Wild Mushrooms, Prunes, and spices are braised in red wine for hours to achieve this amazing comfort food.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
17,77_8,Tell about Bigos stew.,bigos is a traditional polish dish that originated in medieval times.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
3,77_8,Tell about Bigos stew.,bigos is a traditional polish dish that originated in medieval times.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
30,78_1,What is the keto diet?,"The keto diet is a low-carbohydrate, low-fat diet.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
8,78_1,What is the keto diet?,"The keto diet is a low-carbohydrate, low-fat diet.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
10,78_1,What is the keto diet?," The keto diet is a low-carbohydrate, high-fat diet.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,78_1,What is the keto diet?," The keto diet is a low-carbohydrate, high-fat diet.",gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
10,78_1,What is the keto diet?,"The keto diet is a low-carbohydrate, high-fat diet.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,78_1,What is the keto diet?,"The keto diet is a low-carbohydrate, high-fat diet.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
8,78_1,What is the keto diet?,"The ketogenic diet is a low-carb, high-fat diet that causes weight loss and provides numerous health benefits.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
5,78_1,What is the keto diet?,"The ketogenic diet is a low-carb, high-fat diet that causes weight loss and provides numerous health benefits.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
25,78_1,What is the keto diet?,"The keto diet is a low-carbohydrate, high-fat, plant-based diet.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,78_1,What is the keto diet?,"The keto diet is a low-carbohydrate, high-fat, plant-based diet.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
62,78_3,What is ketosis?,Ketosis is a natural metabolic state where the body uses its fat stores.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
54,78_3,What is ketosis?,Ketosis is a natural metabolic state where the body uses its fat stores.,simple-scai-qrecc21-test-dataset-rewritten-2021-07-20-scai-qrecc21-simple-baseline-no-run-identifier-2021-07-21-08-58-25,true,,false,false,,
24,78_3,What is ketosis?,"During ketosis, your body breaks down fat instead of carbohydrates so all of your living cells have enough energy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
5,78_3,What is ketosis?,"During ketosis, your body breaks down fat instead of carbohydrates so all of your living cells have enough energy.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
28,78_3,What is ketosis?,Ketosis is a metabolic state in which the body burns fat for energy.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,78_3,What is ketosis?,Ketosis is a metabolic state in which the body burns fat for energy.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
15,78_3,What is ketosis?,"In this state, the body is almost completely fuelled by fat. When the body results to breaking down fat, it produces an acid called ketones or ketone bodies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,,
5,78_3,What is ketosis?,"In this state, the body is almost completely fuelled by fat. When the body results to breaking down fat, it produces an acid called ketones or ketone bodies.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
65,78_4,What is paleo diet?,Paleo is a diet based on the principles of the paleolithic diet.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,78_4,What is paleo diet?,Paleo is a diet based on the principles of the paleolithic diet.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
4,78_4,What is paleo diet?,"The Paleo diet, sometimes referred to as the caveman diet, is based on the principle that eating foods that were available to early humans will promote optimal health.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,78_4,What is paleo diet?,"The Paleo diet, sometimes referred to as the caveman diet, is based on the principle that eating foods that were available to early humans will promote optimal health.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,78_4,What is paleo diet?,Paleo Diet is an American paleo diet.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
15,78_4,What is paleo diet?,Paleo Diet is an American paleo diet.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,It doesn't answer what the diet is.,false,true,,
82,78_4,What is paleo diet?,Paleo is a diet that was used by the pre-historic peoples of North America between the late 1990s and the early 2000s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
13,78_4,What is paleo diet?,Paleo is a diet that was used by the pre-historic peoples of North America between the late 1990s and the early 2000s.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,GOOD,false,false,,
15,78_4,What is paleo diet?,Paleo is a diet that is based on the idea that humans were meant to eat the same foods that they did during the Paleolithic era.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
11,78_4,What is paleo diet?,Paleo is a diet that is based on the idea that humans were meant to eat the same foods that they did during the Paleolithic era.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,78_4,What is paleo diet?,Paleo is a diet that is based on the diet of the early hominids.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
16,78_4,What is paleo diet?,Paleo is a diet that is based on the diet of the early hominids.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
34,78_4,What is paleo diet?,Paleo is a general term for a diet that followed the diet of the early hominids.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
4,78_4,What is paleo diet?,Paleo is a general term for a diet that followed the diet of the early hominids.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
42,78_7,What is intermittent fasting?,Intermittent fasting is a form of intermittent fasting.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,,
15,78_7,What is intermittent fasting?,Intermittent fasting is a form of intermittent fasting.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting for a specific period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
13,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting for a specific period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
11,78_7,What is intermittent fasting?,Intermittent fasting is a type of fasting that takes place over a period of time.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,78_7,What is intermittent fasting?,Intermittent fasting is a type of fasting that takes place over a period of time.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
16,78_7,What is intermittent fasting?,Intermittent fasting is an eating method that cycles between calorie restriction and normal food consumption during a specific time period.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,78_7,What is intermittent fasting?,Intermittent fasting is an eating method that cycles between calorie restriction and normal food consumption during a specific time period.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,GOOD,false,false,,
9,78_7,What is intermittent fasting?,Intermittent fasting is the practice of abstaining from food for a period of time.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
13,78_7,What is intermittent fasting?,Intermittent fasting is the practice of abstaining from food for a period of time.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,NICE,false,false,,
19,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting for a limited period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
10,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting for a limited period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,GOOD,false,false,,
9,78_7,What is intermittent fasting?,Intermittent fasting is a diet that involves restricting calories for a period of time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
4,78_7,What is intermittent fasting?,Intermittent fasting is a diet that involves restricting calories for a period of time.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
14,78_7,What is intermittent fasting?,intermittent fasting is the practice of abstaining from food or drink for a specific period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
7,78_7,What is intermittent fasting?,intermittent fasting is the practice of abstaining from food or drink for a specific period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
7,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting for a short period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting for a short period of time.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
14,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting intermittently.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
14,78_7,What is intermittent fasting?,Intermittent fasting is the practice of fasting intermittently.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,NICE,false,false,,
11,78_9,What is the 16_8 method in intermittent fasting?,The 16/8 method involves eating during an eight-hour timeframe before fasting for 16.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
7,78_9,What is the 16_8 method in intermittent fasting?,The 16/8 method involves eating during an eight-hour timeframe before fasting for 16.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
11,78_9,What is the 16_8 method in intermittent fasting?,16/8 intermittent fasting involves eating only during an eight-hour window during the day and fasting for the remaining 16 hours.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,78_9,What is the 16_8 method in intermittent fasting?,16/8 intermittent fasting involves eating only during an eight-hour window during the day and fasting for the remaining 16 hours.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
22,78_9,What is the 16_8 method in intermittent fasting?,16 hours of fasting during a day is known as intermittent fasting.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,,
4,78_9,What is the 16_8 method in intermittent fasting?,16 hours of fasting during a day is known as intermittent fasting.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,78_9,What is the 16_8 method in intermittent fasting?,The 168 method of intermittent fasting is a fasting regime that lasts for 168 hours.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,78_9,What is the 16_8 method in intermittent fasting?,The 168 method of intermittent fasting is a fasting regime that lasts for 168 hours.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
52,78_9,What is the 16_8 method in intermittent fasting?,"Intermittent fasting, fasting is when the body does not respond to food intake.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,true,false,,
18,78_9,What is the 16_8 method in intermittent fasting?,"Intermittent fasting, fasting is when the body does not respond to food intake.",ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,good,false,false,,
19,78_9,What is the 16_8 method in intermittent fasting?,The 168 method of intermittent fasting consists of fasting for 168 hours.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
8,78_9,What is the 16_8 method in intermittent fasting?,The 168 method of intermittent fasting consists of fasting for 168 hours.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
17,79_1,What is taught in sociology?,Sociology is the study of human behavior and social interaction.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
9,79_1,What is taught in sociology?,Sociology is the study of human behavior and social interaction.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
11,79_1,What is taught in sociology?,Sociology is the study of society.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
22,79_1,What is taught in sociology?,Sociology is the study of society.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
21,79_1,What is taught in sociology?,"Sociology is a broad study of sociology, focusing on issues such as race, class, religion, demography, and economics.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
6,79_1,What is taught in sociology?,"Sociology is a broad study of sociology, focusing on issues such as race, class, religion, demography, and economics.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
34,79_1,What is taught in sociology?,"Sociology is a broad study of society, including patterns of social interaction, patterns of social interaction, and patterns of culture and society as a whole.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
8,79_1,What is taught in sociology?,"Sociology is a broad study of society, including patterns of social interaction, patterns of social interaction, and patterns of culture and society as a whole.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
11,79_1,What is taught in sociology?,"Sociology is a branch of social science that deals with the sociology of race, ethnicity, and class.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
23,79_1,What is taught in sociology?,"Sociology is a branch of social science that deals with the sociology of race, ethnicity, and class.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,NICE,false,false,,
17,79_1,What is taught in sociology?,Sociology is the study of human behaviour and society.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,79_1,What is taught in sociology?,Sociology is the study of human behaviour and society.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
16,79_1,What is taught in sociology?,"Sociology is a broad study of society, focusing on issues such as race, religion, class, and social interaction.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
18,79_1,What is taught in sociology?,"Sociology is a broad study of society, focusing on issues such as race, religion, class, and social interaction.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,GOOD,false,false,,
7,79_1,What is taught in sociology?,Sociology is the study of human behaviour in society and how this interacts with culture and society.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
17,79_1,What is taught in sociology?,Sociology is the study of human behaviour in society and how this interacts with culture and society.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,good,false,false,,
10,79_1,What is taught in sociology?,Sociology is the study of society and how it develops.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
18,79_1,What is taught in sociology?,Sociology is the study of society and how it develops.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,GOOD,false,false,,
11,79_1,What is taught in sociology?,The purpose of the study of sociology is to develop an understanding of human relationships.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
4,79_1,What is taught in sociology?,The purpose of the study of sociology is to develop an understanding of human relationships.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,79_1,What is taught in sociology?,"Sociology is a broad study of society, including patterns of social relationships, social interaction, and culture.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
8,79_1,What is taught in sociology?,"Sociology is a broad study of society, including patterns of social relationships, social interaction, and culture.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
6,79_1,What is taught in sociology?,Sociology is the study of society as a whole and how individuals and society relate to each other.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,false,true,,
23,79_1,What is taught in sociology?,Sociology is the study of society as a whole and how individuals and society relate to each other.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,GOOD,false,false,,
17,79_3,What is the role of positivism in sociology?,Positivism is the belief that knowledge can be obtained through observation and experimentation.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
5,79_3,What is the role of positivism in sociology?,Positivism is the belief that knowledge can be obtained through observation and experimentation.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
13,79_3,What is the role of positivism in sociology?,positivism is broadly understood as a scientific approach to the study of society,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,false,true,,
15,79_3,What is the role of positivism in sociology?,positivism is broadly understood as a scientific approach to the study of society,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,GOOD,false,false,,
17,79_3,What is the role of positivism in sociology?,"In Sociology, positivism is broadly understood as a scientific approach to the study of society.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
41,79_3,What is the role of positivism in sociology?,"In Sociology, positivism is broadly understood as a scientific approach to the study of society.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
15,79_6,What is the functionalist theory in sociology?,"In the functionalist perspective, society and its institutions are the primary units of analysis.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
62,79_6,What is the functionalist theory in sociology?,"In the functionalist perspective, society and its institutions are the primary units of analysis.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,"Functionalism, in social sciences, theory based on the premise that all aspects of a society—institutions, roles, norms, etc. .",false,false,,
24,79_6,What is the functionalist theory in sociology?,Functionalism is a theory of social organization that posits that social structures are made up of a number of independent components.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
10,79_6,What is the functionalist theory in sociology?,Functionalism is a theory of social organization that posits that social structures are made up of a number of independent components.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
12,79_6,What is the functionalist theory in sociology?,"The functionalist theory is a theory that emphasizes the pre-eminence of the social world over its individual parts (i.e. its constituent actors, human subjects).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,79_6,What is the functionalist theory in sociology?,"The functionalist theory is a theory that emphasizes the pre-eminence of the social world over its individual parts (i.e. its constituent actors, human subjects).",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,79_6,What is the functionalist theory in sociology?,"A broad historical paradigm in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
17,79_6,What is the functionalist theory in sociology?,"A broad historical paradigm in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,NICE,false,false,,
10,79_6,What is the functionalist theory in sociology?,Functionalism is the belief that society is a complex system that functions to maintain itself.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
12,79_6,What is the functionalist theory in sociology?,Functionalism is the belief that society is a complex system that functions to maintain itself.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,NICE,false,false,,
50,79_6,What is the functionalist theory in sociology?,"Functionalism is a broad historical paradigm in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
12,79_6,What is the functionalist theory in sociology?,"Functionalism is a broad historical paradigm in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,GOOD,false,false,,
23,79_6,What is the functionalist theory in sociology?,"A broad historical perspective in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
4,79_6,What is the functionalist theory in sociology?,"A broad historical perspective in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
23,79_6,What is the functionalist theory in sociology?,"The functionalist theory in sociology is a broad historical paradigm in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
29,79_6,What is the functionalist theory in sociology?,"The functionalist theory in sociology is a broad historical paradigm in both sociology and anthropology, functionalism addresses the social structure as a whole and in terms of the necessary function of its constituent elements.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,NICE,false,false,,
27,79_6,What is the functionalist theory in sociology?,The functionalist perspective attempts to explain social institutions as collective means to meet individual and social needs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
4,79_6,What is the functionalist theory in sociology?,The functionalist perspective attempts to explain social institutions as collective means to meet individual and social needs.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
26,79_7,What is the main criticism of functionalist theory in sociology?,Some consider it conservatively biased. Functionalism has been criticized for its failure to account for social change and individual agency; some consider it conservatively biased.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,79_7,What is the main criticism of functionalist theory in sociology?,Some consider it conservatively biased. Functionalism has been criticized for its failure to account for social change and individual agency; some consider it conservatively biased.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,79_7,What is the main criticism of functionalist theory in sociology?,Functionalism is criticized for its lack of a clear definition of society.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
22,79_7,What is the main criticism of functionalist theory in sociology?,Functionalism is criticized for its lack of a clear definition of society.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,,
53,79_7,What is the main criticism of functionalist theory in sociology?,functionalism has been criticized for its failure to account for social change and individual agency,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
12,79_7,What is the main criticism of functionalist theory in sociology?,functionalism has been criticized for its failure to account for social change and individual agency,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,GOOD,false,false,,
14,79_7,What is the main criticism of functionalist theory in sociology?,The functionalist theory has been criticized for its failure to account for social change and individual agency; some consider it conservatively biased.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
15,79_7,What is the main criticism of functionalist theory in sociology?,The functionalist theory has been criticized for its failure to account for social change and individual agency; some consider it conservatively biased.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
5,79_7,What is the main criticism of functionalist theory in sociology?,Some critics also take issue with functionalism’s tendency to attribute needs to society.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
21,79_7,What is the main criticism of functionalist theory in sociology?,Some critics also take issue with functionalism’s tendency to attribute needs to society.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,false,,false,true,,
24,8_2,What is exempt for the Securities Act of 1933?,The Securities Act of 1933 exempts certain classes of securities from regulation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
57,8_2,What is exempt for the Securities Act of 1933?,The Securities Act of 1933 exempts certain classes of securities from regulation.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
16,8_2,What is exempt for the Securities Act of 1933?,Some securities offerings are exempted from the registration requirement of the Securities Act of 1933.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
9,8_2,What is exempt for the Securities Act of 1933?,Some securities offerings are exempted from the registration requirement of the Securities Act of 1933.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-no-run-identifier-2021-09-08-15-04-28,true,,false,false,,
70,8_2,What is exempt for the Securities Act of 1933?,Certain securities offerings are exempt from the registration requirement of the Securities Act of 1933.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,,false,true,confusing answer,
33,8_2,What is exempt for the Securities Act of 1933?,Certain securities offerings are exempt from the registration requirement of the Securities Act of 1933.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,confusing answer,
9,8_2,What is exempt for the Securities Act of 1933?,"Exempt from the Securities Act of 1933 are intrastate offerings of limited size securities issued by issuers, state, and federal governments to a limited number of persons or institutions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,confusing answer,
36,8_2,What is exempt for the Securities Act of 1933?,"Exempt from the Securities Act of 1933 are intrastate offerings of limited size securities issued by issuers, state, and federal governments to a limited number of persons or institutions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,,true,false,confusing answer,
3,8_2,What is exempt for the Securities Act of 1933?,The Securities Act of 1933 exempted certain types of private placements.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
25,8_2,What is exempt for the Securities Act of 1933?,The Securities Act of 1933 exempted certain types of private placements.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
20,8_2,What is exempt for the Securities Act of 1933?,"An exemption from the registration requirement of the Securities Act of 1933 is for intrastate offerings of limited size securities issued by issuers, state, and federal governments to a limited number of persons or institutions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,false,,true,false,confusing answer,
4,8_2,What is exempt for the Securities Act of 1933?,"An exemption from the registration requirement of the Securities Act of 1933 is for intrastate offerings of limited size securities issued by issuers, state, and federal governments to a limited number of persons or institutions.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,confusing answer,
68,8_2,What is exempt for the Securities Act of 1933?,The Securities Act of 1933 exempts certain classes of securities from registration.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,good,false,false,confusing answer,
42,8_2,What is exempt for the Securities Act of 1933?,The Securities Act of 1933 exempts certain classes of securities from registration.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,false,,false,true,confusing answer,
107,8_2,What is exempt for the Securities Act of 1933?,the securities act of 1933 exempts issuers from most of the requirements of,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
66,8_2,What is exempt for the Securities Act of 1933?,the securities act of 1933 exempts issuers from most of the requirements of,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,correct answer,
14,8_5,What is the largest securities exchange in the world?,The New York Stock Exchange is the largest stock exchange in the world.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
18,8_5,What is the largest securities exchange in the world?,The New York Stock Exchange is the largest stock exchange in the world.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,8_5,What is the largest securities exchange in the world?,"The New York Stock Exchange founded on May 17, 1792, is the world's biggest stock exchange in trader value and has a capitalization of",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,malformed answer,
8,8_5,What is the largest securities exchange in the world?,"The New York Stock Exchange founded on May 17, 1792, is the world's biggest stock exchange in trader value and has a capitalization of",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,false,,false,true,malformed answer,
17,8_5,What is the largest securities exchange in the world?,The largest securities exchange in the world is the New York Stock Exchange.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,true,,false,false,confusing answer,
13,8_5,What is the largest securities exchange in the world?,The largest securities exchange in the world is the New York Stock Exchange.,gpt3-scai-qrecc21-test-dataset-2021-07-20-scai-qrecc21-gpt3-baseline-no-run-identifier-2021-07-21-08-56-42,false,,false,true,confusing answer,
21,8_6,How and when was the largest securities exchange in the world created?,"The New York Stock Exchange founded on May 17, 1792, is the third largest stock exchange in the world and has a capitalization of",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
64,8_6,How and when was the largest securities exchange in the world created?,"The New York Stock Exchange founded on May 17, 1792, is the third largest stock exchange in the world and has a capitalization of",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
114,8_6,How and when was the largest securities exchange in the world created?,The New York Stock Exchange is the largest stock exchange in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
67,8_6,How and when was the largest securities exchange in the world created?,The New York Stock Exchange is the largest stock exchange in the world.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
91,8_6,How and when was the largest securities exchange in the world created?,The New York Stock Exchange is the largest stock exchange in the world created,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
16,8_6,How and when was the largest securities exchange in the world created?,The New York Stock Exchange is the largest stock exchange in the world created,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
15,8_6,How and when was the largest securities exchange in the world created?,The New York Stock Exchange is the largest stock exchange in the world. Main articles: Banking in the United States and Insurance in the United States,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,random answer,
54,8_6,How and when was the largest securities exchange in the world created?,The New York Stock Exchange is the largest stock exchange in the world. Main articles: Banking in the United States and Insurance in the United States,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,false,,false,true,correct answer,
16,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During World War II, Solzhenitsyn served as a sound-ranging battery commander in the Red Army.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
12,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During World War II, Solzhenitsyn served as a sound-ranging battery commander in the Red Army.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
15,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During the war, Aleksandr Solzhenitsyn served as the commander of a sound-ranging battery in the Red Army.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
3,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During the war, Aleksandr Solzhenitsyn served as the commander of a sound-ranging battery in the Red Army.",ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
11,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During World War II, Solzhenitsyn served as the commander of a sound-ranging battery in the Red Army, was involved in major action at the front, and was twice decorated.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
19,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During World War II, Solzhenitsyn served as the commander of a sound-ranging battery in the Red Army, was involved in major action at the front, and was twice decorated.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
16,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During World War II, Aleksandr Solzhenitsyn served as the commander of a sound-ranging battery in the Red Army",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
9,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,"During World War II, Aleksandr Solzhenitsyn served as the commander of a sound-ranging battery in the Red Army",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-04-10-38-07,true,,false,false,,
16,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,aleksandr solzhenitsyn served as an artillery officer in the red army during,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
36,87_1,What was Aleksandr Solzhenitsyn's role during World War II?,aleksandr solzhenitsyn served as an artillery officer in the red army during,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,"While serving as a captain in the Red Army during World War II, Solzhenitsyn was arrested by the SMERSH and sentenced to eight years in the Gulag and then internal exile for criticizing Soviet leader Joseph Stalin in a private letter.",false,false,,
13,88_1,Did Diosdado Macapagal serve in the Philippine House of Representatives?,Diosdado Macapagal was a member of the House of Representatives from Pampanga's 1st district 1947–1957.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
21,88_1,Did Diosdado Macapagal serve in the Philippine House of Representatives?,Diosdado Macapagal was a member of the House of Representatives from Pampanga's 1st district 1947–1957.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
20,88_1,Did Diosdado Macapagal serve in the Philippine House of Representatives?,Diosdado Macapagal served in the Philippine House of Representatives from 1957–1961.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
3,88_1,Did Diosdado Macapagal serve in the Philippine House of Representatives?,Diosdado Macapagal served in the Philippine House of Representatives from 1957–1961.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
88,88_1,Did Diosdado Macapagal serve in the Philippine House of Representatives?,Diosdado Macapagal served in the Philippine House of Representatives.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
3,88_1,Did Diosdado Macapagal serve in the Philippine House of Representatives?,Diosdado Macapagal served in the Philippine House of Representatives.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
8,9_1,Why is statistics important?,The field of statistics includes study and analyzing the data in practice.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,false,,false,true,confusing answer,
77,9_1,Why is statistics important?,The field of statistics includes study and analyzing the data in practice.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,confusing answer,
5,9_1,Why is statistics important?,"Statistics is the study, analysis, and interpretation of information, data, and statistics.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,confusing answer,
87,9_1,Why is statistics important?,"Statistics is the study, analysis, and interpretation of information, data, and statistics.",rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,confusing answer,
7,9_1,Why is statistics important?,"The field of statistics is the science of learning from data. Statistical knowledge helps you use the proper methods to collect the data, employ the correct analyses,",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
14,9_1,Why is statistics important?,"The field of statistics is the science of learning from data. Statistical knowledge helps you use the proper methods to collect the data, employ the correct analyses,",torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
9,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 1993-2019.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
4,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 1993-2019.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
11,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox for the 2011 season.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,false,,false,true,,
31,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox for the 2011 season.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
19,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 2001 to 2004.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
16,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 2001 to 2004.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
10,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox for one year.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
10,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox for one year.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
9,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 1993 to 2004.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
3,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 1993 to 2004.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
15,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 2009 to 2011.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,true,,false,false,,
37,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Sky Sox from 2009 to 2011.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-07-49,false,"The answer doesn't say how long he played for them, although it does state the years.",false,true,,
4,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Colorado Springs Sky Sox from 2009-2012.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
17,95_3,How long did Jason Giambi play for the Sky Sox?,Jason Giambi played for the Colorado Springs Sky Sox from 2009-2012.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,GOOD,false,false,,
11,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base for the Colorado Rockies.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
9,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base for the Colorado Rockies.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
12,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base and designated hitter for the Rockies.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base and designated hitter for the Rockies.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi was an American professional baseball player.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,true,,false,false,,
18,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi was an American professional baseball player.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-06-44,false,It doesn't state the position he played.,false,true,,
21,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base for the Rockies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
9,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base for the Rockies.,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-rag-bm25_100-ground_truth_rewrites-submission_correct_turn_no-2021-09-19-18-40-28,true,,false,false,,
12,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base and designated hitter for the Colorado Rockies.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
25,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi played first base and designated hitter for the Colorado Rockies.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
12,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi is an American former professional baseball first baseman and designated hitter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
4,95_6,What position did Jason Giambi play for the Rockies?,Jason Giambi is an American former professional baseball first baseman and designated hitter.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-05-06,true,,false,false,,
66,95_7,Did anything else important happen when Jason Giambi was with the Rockies besides becoming a free agent after the 2012 season and being a finalist for the Rockies major league managerial opening?,Jason Giambi became the first player in franchise history to hit 20 home runs in a season.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
19,95_7,Did anything else important happen when Jason Giambi was with the Rockies besides becoming a free agent after the 2012 season and being a finalist for the Rockies major league managerial opening?,Jason Giambi became the first player in franchise history to hit 20 home runs in a season.,ultron-scai-qrecc21-test-dataset-2021-07-20-ultron-no-run-identifier-2021-09-04-17-16-58,true,,false,false,,
34,95_7,Did anything else important happen when Jason Giambi was with the Rockies besides becoming a free agent after the 2012 season and being a finalist for the Rockies major league managerial opening?,Jason Giambi became the first player in Major League history to hit 40 home runs in a season.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
33,95_7,Did anything else important happen when Jason Giambi was with the Rockies besides becoming a free agent after the 2012 season and being a finalist for the Rockies major league managerial opening?,Jason Giambi became the first player in Major League history to hit 40 home runs in a season.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
19,95_7,Did anything else important happen when Jason Giambi was with the Rockies besides becoming a free agent after the 2012 season and being a finalist for the Rockies major league managerial opening?,Jason Giambi became the first player in MLB history to hit a home run in each of his first three seasons with the same team.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,,false,false,,
51,95_7,Did anything else important happen when Jason Giambi was with the Rockies besides becoming a free agent after the 2012 season and being a finalist for the Rockies major league managerial opening?,Jason Giambi became the first player in MLB history to hit a home run in each of his first three seasons with the same team.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-21-49-44,true,GOOD,false,false,,
19,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,giambi was named by fbi officers investigating the bay area laboratory co - operative ( balco ) as being one of the baseball players believed to have received anabolic steroids from trainer greg anderson.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,true,,false,false,,
7,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,giambi was named by fbi officers investigating the bay area laboratory co - operative ( balco ) as being one of the baseball players believed to have received anabolic steroids from trainer greg anderson.,rali-scai-qrecc21-test-dataset-rewritten-2021-07-20-rali-qa-no-run-identifier-2021-09-09-13-01-07,false,,true,false,,
36,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,"Late in 2003, Jason Giambi was named by FBI officers investigating the Bay Area Laboratory Co-operative as being one of the baseball players believed to have received anabolic steroids from trainer Greg Anderson.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
4,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,"Late in 2003, Jason Giambi was named by FBI officers investigating the Bay Area Laboratory Co-operative as being one of the baseball players believed to have received anabolic steroids from trainer Greg Anderson.",rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-15-19-36-31,true,,false,false,,
18,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,Jason Giambi was named by FBI officers investigating the Bay Area Laboratory Co-operative as being one of the baseball players believed to have received anabolic steroids from trainer Greg Anderson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
4,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,Jason Giambi was named by FBI officers investigating the Bay Area Laboratory Co-operative as being one of the baseball players believed to have received anabolic steroids from trainer Greg Anderson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-06-09-21-43,true,,false,false,,
19,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,Jason Giambi was named by FBI officers investigating the Bay Area Laboratory Co-operative (BALCO) as being one of the baseball players believed to have received anabolic steroids from trainer Greg Anderson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
18,96_2,What was the scandal with Jason Giambi and the Bay Area Laboratory Co-operative?,Jason Giambi was named by FBI officers investigating the Bay Area Laboratory Co-operative (BALCO) as being one of the baseball players believed to have received anabolic steroids from trainer Greg Anderson.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
7,99_5,Was Glamazon a nickname for Beth Phoenix?,Beth Phoenix is known by her ring name Glamazon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
46,99_5,Was Glamazon a nickname for Beth Phoenix?,Beth Phoenix is known by her ring name Glamazon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-15-40-34,true,,false,false,,
18,99_5,Was Glamazon a nickname for Beth Phoenix?,WWE Hall of Famer Beth Phoenix was known by her stage name Glamazon.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
22,99_5,Was Glamazon a nickname for Beth Phoenix?,WWE Hall of Famer Beth Phoenix was known by her stage name Glamazon.,rachael-scai-qrecc21-test-dataset-rewritten-2021-07-20-rachael-no-run-identifier-2021-09-04-10-39-42,true,,false,false,,
84,99_5,Was Glamazon a nickname for Beth Phoenix?,Glamazon is a nickname for Beth Phoenix.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
3,99_5,Was Glamazon a nickname for Beth Phoenix?,Glamazon is a nickname for Beth Phoenix.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-07-57,true,,false,false,,
14,99_5,Was Glamazon a nickname for Beth Phoenix?,Glamazon is a nickname for WWE Hall of Famer Beth Phoenix.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
5,99_5,Was Glamazon a nickname for Beth Phoenix?,Glamazon is a nickname for WWE Hall of Famer Beth Phoenix.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-08-07-09-57,true,,false,false,,
16,99_5,Was Glamazon a nickname for Beth Phoenix?,glamazon is so-named because of beth phoenix's previous,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,false,,true,false,,
19,99_5,Was Glamazon a nickname for Beth Phoenix?,glamazon is so-named because of beth phoenix's previous,ultron-scai-qrecc21-test-dataset-rewritten-2021-07-20-ultron-BART-large-top1BM25-2021-09-13-17-47-43,true,,false,false,,
25,99_5,Was Glamazon a nickname for Beth Phoenix?,Beth Phoenix's nickname was Glamazon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
19,99_5,Was Glamazon a nickname for Beth Phoenix?,Beth Phoenix's nickname was Glamazon.,rachael-scai-qrecc21-test-dataset-2021-07-20-rachael-no-run-identifier-2021-09-15-09-08-40,true,,false,false,,
7,99_5,Was Glamazon a nickname for Beth Phoenix?,"Glamazon was a nickname for Beth Phoenix, which means ""the name """,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,
8,99_5,Was Glamazon a nickname for Beth Phoenix?,"Glamazon was a nickname for Beth Phoenix, which means ""the name """,torch-scai-qrecc21-test-dataset-2021-07-20-torch-usi_T5_raw2-2021-09-20-05-42-29,true,,false,false,,