Decentralized workflow management on software defined infrastructure

Data intensive workflow applications are characterized by their continuously growing volumes of data being processing, complexity of tasks in the pipeline, and infrastructure capacity required for computation and storage. The infrastructure technologies of computing, storage and networking have made tremendous progress during the past yeas. We review the emerging trends in the data-intensive workflow applications, in particular the potential challenges and opportunities enabled by the decentralized application paradigm.