Corpus ID: 235358500

PAIO: A Software-Defined Storage Data Plane Framework

@article{Macedo2021PAIOAS,
  title={PAIO: A Software-Defined Storage Data Plane Framework},
  author={R. Macedo and Y. Tanimura and J. Haga and Vijay Chidambaram and J. Pereira and Joao Paulo Inesc TECUniversity of Minho and National University of Science and Technology and The University of Texas at AustinVMWare Research},
  journal={ArXiv},
  year={2021},
  volume={abs/2106.03617}
}
We propose PAIO, the first general-purpose framework that enables system designers to build custom-made SoftwareDefined Storage (SDS) data plane stages. It provides the means to implement storage optimizations adaptable to different workflows and user-defined policies, and allows straightforward integration with existing applications and I/O layers. PAIO allows stages to be integrated with modern SDS control planes to ensure holistic control and system-wide optimal performance. We demonstrate… Expand

Figures and Tables from this paper

References

SHOWING 1-10 OF 37 REFERENCES
Crystal: Software-Defined Storage for Multi-Tenant Object Stores
TLDR
This work presents Crystal, the first Software-Defined Storage (SDS) architecture whose core objective is to efficiently support multi-tenancy in object stores, and shows that Crystal is an extensible platform to deploy new SDS services for object stores with small overhead. Expand
Malacology: A Programmable Storage System
TLDR
This work introduces the programmable storage approach, which exposes internal services and abstractions of the storage stack as building blocks for higher-level services, and illustrates the advantages and challenges of this approach by composing existing internal abstractions into two new higher- level services. Expand
IOFlow: a software-defined storage architecture
TLDR
IOFlow is an architecture that uses a logically centralized control plane to enable high-level flow policies and adds a queuing abstraction at data-plane stages and exposes this to the controller to translate policies into queuing rules at individual stages. Expand
A Survey and Classification of Software-Defined Storage Systems
TLDR
An in-depth study of SDS systems is presented, providing a thorough description and categorization of each plane of functionality, and a taxonomy and classification of existing SDS solutions according to different criteria are proposed. Expand
SafeFS: a modular architecture for secure user-space file systems: one FUSE to rule them all
TLDR
SafeFS is a modular architecture based on software-defined storage principles featuring stackable building blocks that can be combined to construct a secure distributed file system that allows users to specialize their data store to their specific needs by choosing the combination of blocks that provide the best safety and performance tradeoffs. Expand
Enlightening the I/O Path: A Holistic Approach for Application Performance
TLDR
A request-centric I/O prioritization that dynamically detects and prioritizes I/Os delaying request handling at all layers in the I/ O path is proposed. Expand
From application requests to virtual IOPs: provisioned key-value storage with Libra
TLDR
Libra, a local IO scheduling framework designed for a shared SSD-backed key-value storage system, guarantees per-tenant application-request throughput while achieving high utilization and uses a disk-IO cost model based on virtual IO operations (VOP) that captures the non-linear relationship between SSD IO bandwidth and IO operation (IOP) throughput. Expand
Ceph: a scalable, high-performance distributed file system
TLDR
Performance measurements under a variety of workloads show that Ceph has excellent I/O performance and scalable metadata management, supporting more than 250,000 metadata operations per second. Expand
sRoute: Treating the Storage Stack Like a Network
In a data center, an IO from an application to distributed storage traverses not only the network, but also several software stages with diverse functionality. This set of ordered stages is known asExpand
Differentiated storage services
TLDR
The proposed I/O classification architecture is used to close the widening semantic gap between computer systems and storage systems, and other classes, policies and storage system mechanisms that can be used to improve end-to-end performance, reliability and security are explored. Expand
...
1
2
3
4
...