Journal article Open Access

Sqoop usage in Hadoop Distributed File System and Observations to Handle Common Errors

K. Uma Pavan Kumar; S V N Srinivasu; M N. Nachappa

Sponsor(s)
Blue Eyes Intelligence Engineering and Sciences Publication(BEIESP)

The Hadoop framework provides a way of storing and processing the huge amounts of the data. The social media like Facebook, twitter and amazon uses Hadoop eco system tools so as to store the data in Hadoop distributed file system and to process the data Map Reduce (MR). The current work describes the usage of Sqoop in the process of import and export with HDFS. The work involves various possible import/export commands supported by the tool Sqoop in the eco system of Hadoop. The importance of the work is to highlight the common errors while installing Sqoop and working with Sqoop. Many developers and researchers were using Sqoop so as to perform the import/export process and to handle the source data in the relational format. In the current work the connectivity between mysql and sqoop were presented and various commands usage along with the results were presented. The outcome of the work is for each command the possible errors encountered and the corresponding solution is mentioned. The common configuration settings we have to follow so as to handle the Sqoop without any errors is also mentioned.

Files (243.5 kB)
Name Size
D4980119420.pdf
md5:fc623b7c232aa7c22bdb274cbd53e90f
243.5 kB Download
27
11
views
downloads
Views 27
Downloads 11
Data volume 2.7 MB
Unique views 20
Unique downloads 11

Share

Cite as