Report Open Access

Evaluation of Erasure Coding and other features of Hadoop 3

Nazerke Seidan

Erasure coding, a new feature in HDFS, can reduce storage overhead by approximately 50% 
compared to replication while maintaining the same durability guarantees. This would allow to 
save a lot of disk capacity in needed by project hosted in CERN IT Hadoop service. The goal of 
the project is to evaluate the new features of Hadoop 3 and make an assessment of its readiness 
for production systems (this includes installation and configuration of a test hadoop3 cluster, 
copying production data to it, conducting multiple performance test on the data).  

Files (1.9 MB)
Name Size
Report_Nazerke_Seidan.pdf
md5:0898929539159c205f98bd148bf6cbc9 		1.9 MB Download
264
627
views
downloads
All versions This version
Views 264264
Downloads 627627
Data volume 1.2 GB1.2 GB
Unique views 250250
Unique downloads 592592
More info on how stats are collected.
Indexed in
Publication date:
November 22, 2019
DOI:
10.5281/zenodo.3550780

Zenodo DOI Badge

DOI 

10.5281/zenodo.3550780

Markdown 

[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.3550780.svg)](https://doi.org/10.5281/zenodo.3550780)

reStructedText 

.. image:: https://zenodo.org/badge/DOI/10.5281/zenodo.3550780.svg
   :target: https://doi.org/10.5281/zenodo.3550780

HTML 

<a href="https://doi.org/10.5281/zenodo.3550780"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3550780.svg" alt="DOI"></a>

Image URL 

https://zenodo.org/badge/DOI/10.5281/zenodo.3550780.svg

Target URL 

https://doi.org/10.5281/zenodo.3550780

Keyword(s):
CERN openlab summer student programme
Communities:
License (for files):
Creative Commons Attribution 4.0 International

Versions

Version 1 10.5281/zenodo.3550780 Nov 22, 2019
Cite all versions? You can cite all versions by using the DOI 10.5281/zenodo.3550779. This DOI represents all versions, and will always resolve to the latest one. Read more.

Share

Cite as

Export