Big Data Concept, Analytics and Hadoop Technology: A Systematic Survey

This paper provides insight into the concept of big data and big data analytic platforms like Spark and Storm to handle a variety of data coming from various sources like the Internet of Things (IoT) which could pose a challenge in production in the industries. The paper discusses the concept of Industry 4.0 and shows how big data in Industry 4.0 can lead to the growth of the economy and the promotion of business in the industry. The paper presents some challenges faced by big data and proffers solutions to these challenges. Hadoop technology is suggested as one of the methods to address some of the challenges of big data. The components of Hadoop technology such as Hadoop distributed file system (HDES), Map reduce, HBASE, HCatalog, Pig and so on, are discussed alongside their functions. The methodology followed to achieve these objectives stated above is a systematic review of current works of literature and related works.