Comparing MDD and CcD in the Bug Localization Context: An Empirical Evaluation in Video Games: Replication Package

This folder contains the material of an experiment that compares MDD and CDD with respect to Bug Localization tasks.

The material in this folder* is organized in three subfolders: 01_EXPERIMENT, which contains the information used to run the experiment; 02_RESULTS, which contains the information collected in the experiment; and 03_STATISTICAL ANALYSIS, which contains the data set and the results of the statistical analysis performed.

The documentation contained in each of these folders is described below:

01_EXPERIMENT

11_ CdEUSJ_FavorableReport: pdf file of the Favorable report from the ethical and scientific committee regarding the execution of the experiment.

12_Forms&Tables: This folder contains the Taks Sheet for each group and the scenarios of each task and each group.

13_SupportMaterial: This folder contains the support material that the subjects could use during the performance of the different tasks of the experiment.

14_SessionMaterial: This folder contains the material used by the instructors during the session, including the video tutorial.

15_CorrecctionMaterial: This folder contains the solution to the tasks and the correction template.

02_RESULTS

21_RESULTS: Excel file with the data extracted from the Forms and the pre-processed results before the statistical analysis.

22_SubjectComments&FocusGroup. Pdf file with the analysis of the subjects' comments on the forms, and the transcription of the comments during the sessions and in the focus group.

03_STATISTICAL ANALYSIS

301_DATASET: Data files containing the values of variables and factors necessary for conducting the statistical analysis proposed in the study. They are included in both IBM SPSS Statistics (.sav) and Microsoft Excel (.xlsx) formats.

302_DEMOGRAPHIC: Excel file with the demographic results.

303_DESCRIPTIVES: Files that contain the values of the main descriptive statistics and the results of the normality tests that correspond to all the variables measured in the study: the response variables and the independent variables or factors. They are included in both IBM SPSS Statistics (.spv) and PDF Reader (.pdf) formats.

304_LMM: Files that contain the execution and results of the LMM Type III test of fixed effects with unstructured repeated covariance for all the variables in the study with different statistical models. They are included in both IBM SPSS Statistics (.spv) and PDF Reader (.pdf) formats.

305_DATASET_BugLocalization.xlsx_lmmRes: Files that contain the dataset that includes the residuals of LMM executions. They are included in both IBM SPSS Statistics (.sav) and PDF Reader (.xls) formats.

306_NORMALITYTEST: Files that contain the dataset that includes the normality test of the residuals of LMM executions. They are included in both IBM SPSS Statistics (.spv) and PDF Reader (.pdf) formats.

307_EFFECTSIZE-Cohend: Files that include the computations executed to determine the effect size of the factors in all the dependent variables. They are included in both IBM SPSS Statistics (.spv) and PDF Reader (.pdf) formats.

308_DATASET_BugLocalization.xlsx_lmm_student_Res: Files that contain the dataset that includes the residuals of LMM executions for non-experienced subjects (students) in the study.  They are included in both IBM SPSS Statistics (.sav) and PDF Reader (.xls) formats.

309_LMM_Students: Files that contain the execution and results of the LMM tests (Type III test of fixed effects with unstructured repeated covariance) for non-experienced subjects (students) in the study for all the variables in the study with different statistical models, the normality analysis of the residuals and the computations executed to determine the effect size of the factors considered in each dependent variable. They are included in both IBM SPSS Statistics (.spv) and PDF Reader (.pdf) formats.

310_DATASET_BugLocalization.xlsx_lmm_professionals_Res.xlsx: Files that contain the dataset that includes the residuals of LMM executions for experienced subjects (professionals) in the study. They are included in both IBM SPSS Statistics (.sav) and PDF Reader (.xls) formats.

311_LMM_Profesionales: Files that contain the execution and results of the LMM tests (Type III test of fixed effects with unstructured repeated covariance) for the experienced subjects (professionals) in the study for all the variables in the study with different statistical models, the normality analysis of the residuals and the computations executed to determine the effect size of the factors considered in each dependent variable. They are included in both IBM SPSS Statistics (.spv) and PDF Reader (.pdf) formats.

312_Boxplots: Files that contain the execution and results of the boxplots by method (MDD/CDD) and by Experience (students/professionals). They are included in both IBM SPSS Statistics (.spv) and PDF Reader (.pdf) formats.

*Note: The documentation that appears in this folder contains texts in Spanish, since this is the language in which the experiment is executed.