Published June 15, 2022 | Version v1
Presentation Open

On the Reusability of Data Cleaning Workflows

Description

The goal of data cleaning is to make data fit for purpose, i.e., to improve data quality, through updates and data transformations, such that downstream analyses can be conducted and lead to trustworthy results.  A transparent and reusable data cleaning workflow can save time and effort through automation, and make subsequent data cleaning on new data less error-prone. However, the reusability of data cleaning workflows has received little to no attention in the research community. We identify some challenges and opportunities for reusing data cleaning workflows. We present a high-level conceptual model to clarify what we mean by reusability and propose ways to improve reusability along different dimensions. We use the opportunity of presenting at IDCC to invite the community to share their use cases, experiences, and desiderata for the reuse of data cleaning workflows and recipes in order to foster new collaborations and guide future work.

Notes

This lightning talk is given on 2022-06-14, 17th International Digital Curation Conference (IDCC22)

Files

Reusability for Data Cleaning Workflows.pdf

Files (1.2 MB)

Name Size Download all
md5:e782de53a6a61facf1e9ad58fc0c3a04
1.2 MB Preview Download