DiskReduce: RAID for data-intensive scalable computing

@inproceedings{Fan2009DiskReduceRF,
  title={DiskReduce: RAID for data-intensive scalable computing},
  author={Bin Fan and Wittawat Tantisiriroj and Lin Xiao and Garth A. Gibson},
  booktitle={PDSW '09},
  year={2009}
}
Data-intensive file systems, developed for Internet services and popular in cloud computing, provide high reliability and availability by replicating data, typically three copies of everything. Alternatively high performance computing, which has comparable scale, and smaller scale enterprise storage systems get similar tolerance for multiple failures from lower overhead erasure encoding, or RAID, organizations. DiskReduce is a modification of the Hadoop distributed file system (HDFS) enabling… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 87 CITATIONS

Erasure Code based Cloud Storage File system-Minimizing IO Recovery S .

  • 2013
VIEW 10 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Efficiently Coding Replicas to Erasure Coded Blocks in Distributed Storage Systems

  • IEEE Communications Letters
  • 2017
VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Dynamic erasure coding decision for modern block-oriented distributed storage systems

  • The Journal of Supercomputing
  • 2016
VIEW 4 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Making mapreduce scheduling effective in erasure-coded storage clusters

  • The 21st IEEE International Workshop on Local and Metropolitan Area Networks
  • 2015
VIEW 5 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Big data storage workload characterization, modeling and synthetic generation

VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Alpha Entanglement Codes: Practical Erasure Codes to Archive Data in Unreliable Environments

  • 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)
  • 2018
VIEW 1 EXCERPT
CITES BACKGROUND

An In-Network Aggregation Scheme for Erasure Coding Storage Systems in Data Centers

  • 2018 Sixth International Conference on Advanced Cloud and Big Data (CBD)
  • 2018
VIEW 1 EXCERPT
CITES METHODS

Topology-Aware Efficient Storage Scheme for Fault-Tolerant Storage Systems in Data Centers

  • 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS)
  • 2018
VIEW 1 EXCERPT
CITES METHODS

FILTER CITATIONS BY YEAR

2010
2018

CITATION STATISTICS

  • 6 Highly Influenced Citations

References

Publications referenced by this paper.
SHOWING 1-2 OF 2 REFERENCES

Hdfs and erasure codes, aug

D. Borthakur
  • 2009
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Jerasure: A library in c/c++ facilitating erasure coding for storage applications - version 1.2

J. S. Plank, S. Simmerman, C. D. Schuman
  • Technical Report UT-CS-08-627,
  • 2008
VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL