pWalrus: Towards better integration of parallel file systems into cloud storage

  title={pWalrus: Towards better integration of parallel file systems into cloud storage},
  author={Yoshihisa Abe and G. Gibson},
  journal={2010 IEEE International Conference On Cluster Computing Workshops and Posters (CLUSTER WORKSHOPS)},
Amazon S3-style storage is an attractive option for clouds that provides data access over HTTP/HTTPS. At the same time, parallel file systems are an essential component in privately owned clusters that enable highly scalable dataintensive computing. In this work, we take advantage of both of those storage options, and propose pWalrus, a storage service layer that integrates parallel file systems effectively into cloud storage. Essentially, it exposes the mapping between S3 objects and backing… CONTINUE READING
Highly Cited
This paper has 27 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 17 extracted citations

The Gfarm File System on Compute Clouds

2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum • 2011
View 4 Excerpts
Highly Influenced

Could Blobs Fuel Storage-Based Convergence Between HPC and Big Data?

2017 IEEE International Conference on Cluster Computing (CLUSTER) • 2017
View 1 Excerpt

Dynamic Block Partitioning Strategy for Cloud-Backed File Systems

2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom) • 2016
View 2 Excerpts

KVLight: A Lightweight Key-Value Store for Distributed Access in Cloud

2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) • 2016
View 1 Excerpt

Wiki-health : from quantified self to self-understanding

Future Generation Comp. Syst. • 2014
View 1 Excerpt


Publications referenced by this paper.
Showing 1-10 of 10 references

The Eucalyptus Open-Source Cloud-Computing System

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid • 2009
View 3 Excerpts
Highly Influenced

NFS Pathless Objects (Internet-Draft)

D. Roy, M. Eisler, RN A.
2010. • 2010
View 1 Excerpt

PLFS: a checkpoint filesystem for parallel applications

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis • 2009
View 1 Excerpt

HMAC : Keyed - hashing for message authentication , ” 1997 . [ 8 ] “ Amazon Elastic Compute Cloud ( Amazon EC 2 )

M. Bellare H. Krawczyk, R. Canetti
Schmuck and R . Haskin , “ GPFS : a shared - disk file system for large computing clusters , ” in FAST ’ 02 : Proceedings of the 1 st USENIX Conference on File and Storage Technologies • 2002

Similar Papers

Loading similar papers…