Report Open Access
Evaluation of Erasure Coding and other features of Hadoop 3
Nazerke Seidan
Erasure coding, a new feature in HDFS, can reduce storage overhead by approximately 50%
compared to replication while maintaining the same durability guarantees. This would allow to
save a lot of disk capacity in needed by project hosted in CERN IT Hadoop service. The goal of
the project is to evaluate the new features of Hadoop 3 and make an assessment of its readiness
for production systems (this includes installation and configuration of a test hadoop3 cluster,
copying production data to it, conducting multiple performance test on the data).
Files
(1.9 MB)
| Name | Size | |
|---|---|---|
|
Report_Nazerke_Seidan.pdf
md5:0898929539159c205f98bd148bf6cbc9 |
1.9 MB | Download |
0
0
views
downloads
| All versions | This version | |
|---|---|---|
| Views | 0 | 0 |
| Downloads | 0 | 0 |
| Data volume | 0 Bytes | 0 Bytes |
| Unique views | 0 | 0 |
| Unique downloads | 0 | 0 |
Indexed in
- Publication date:
- November 22, 2019
- DOI:
-
- Keyword(s):
- CERN openlab summer student programme
- License (for files):
- Creative Commons Attribution 4.0 International