DiskReduce: RAID for data-intensive scalable computing
@inproceedings{Fan2009DiskReduceRF, title={DiskReduce: RAID for data-intensive scalable computing}, author={Bin Fan and Wittawat Tantisiriroj and Lin Xiao and Garth A. Gibson}, booktitle={PDSW '09}, year={2009} }
Data-intensive file systems, developed for Internet services and popular in cloud computing, provide high reliability and availability by replicating data, typically three copies of everything. Alternatively high performance computing, which has comparable scale, and smaller scale enterprise storage systems get similar tolerance for multiple failures from lower overhead erasure encoding, or RAID, organizations. DiskReduce is a modification of the Hadoop distributed file system (HDFS) enabling… CONTINUE READING
Citations
Publications citing this paper.
SHOWING 1-10 OF 87 CITATIONS
XORing Elephants: Novel Erasure Codes for Big Data
VIEW 21 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED
Erasure Code based Cloud Storage File system-Minimizing IO Recovery S .
VIEW 10 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED
Efficiently Coding Replicas to Erasure Coded Blocks in Distributed Storage Systems
VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED
Dynamic erasure coding decision for modern block-oriented distributed storage systems
VIEW 4 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED
Making mapreduce scheduling effective in erasure-coded storage clusters
VIEW 5 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED
Big data storage workload characterization, modeling and synthetic generation
VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED
Alpha Entanglement Codes: Practical Erasure Codes to Archive Data in Unreliable Environments
VIEW 1 EXCERPT
CITES BACKGROUND
An In-Network Aggregation Scheme for Erasure Coding Storage Systems in Data Centers
VIEW 1 EXCERPT
CITES METHODS
Mirrored and Hybrid Disk Arrays: Organization, Scheduling, Reliability, and Performance
VIEW 1 EXCERPT
CITES METHODS
Topology-Aware Efficient Storage Scheme for Fault-Tolerant Storage Systems in Data Centers
VIEW 1 EXCERPT
CITES METHODS
FILTER CITATIONS BY YEAR
CITATION STATISTICS
6 Highly Influenced Citations
References
Publications referenced by this paper.
SHOWING 1-2 OF 2 REFERENCES
Hdfs and erasure codes, aug
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL
Jerasure: A library in c/c++ facilitating erasure coding for storage applications - version 1.2
VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL