• Corpus ID: 201870666

State of the Art on the Quality of Big Data: A Systematic Literature Review and Classification Framework

@article{Mirzaie2019StateOT,
  title={State of the Art on the Quality of Big Data: A Systematic Literature Review and Classification Framework},
  author={Mostafa Mirzaie and Behshid Behkamal and Samad Paydar},
  journal={arXiv: Databases},
  year={2019}
}
One of the most significant problems of Big Data is to extract knowledge through the huge amount of data. The usefulness of the extracted information depends strongly on data quality. In addition to the importance, data quality has recently been taken into consideration by the big data community and there is not any comprehensive review conducted in this area. Therefore, the purpose of this study is to review and present the state of the art on the quality of big data research through a… 
2 Citations

Big Data Quality: Factors, Frameworks, and Challenges

This research has listed different quality factors and dimensions and quality frameworks that are commonly used to measure the Big data quality measurement, and the frequent challenges that the researchers and data scientists are faced through the Big Data quality measurement process.

Using Trust as a Measure to Derive Data Quality in Data Shared IoT Deployments

An analysis of data quality as it is represented in Internet of Things (IoT) systems and some of the limitations of this representation are presented and the use of trust as a heuristic to drive data quality measurements is introduced.

References

SHOWING 1-10 OF 116 REFERENCES

The Challenges of Data Quality and Data Quality Assessment in the Big Data Era

The data characteristics of the big data environment are analyzed, quality challenges faced by big data are presented, and a hierarchical data quality framework is formulates from the perspective of data users.

From Data Quality to Big Data Quality

The nature of the relationship between Data Quality and several research coordinates that are relevant in Big Data, such as the variety of data types, data sources and application domains, are examined, focusing on maps, semi-structured texts, linked open data, sensor & sensor networks and official statistics.

Antecedents of big data quality: An empirical examination in financial service organizations

The overall findings indicate that there are no fundamentally new data quality issues in big data projects and the complexity of the issues is higher, which makes it harder to assess and attain data quality inbig data projects compared to the traditional projects.

Overview of data quality challenges in the context of Big Data

  • Suraj Juddoo
  • Computer Science
    2015 International Conference on Computing, Communication and Security (ICCCS)
  • 2015
Investigation of various components and activities forming part of data quality management such as dimensions, metrics, data quality rules, data profiling and data cleansing list existing challenges and future research areas associated with Big Data for dataquality management.

An Hybrid Approach to Quality Evaluation across Big Data Value Chain

A hybrid approach to Big Data quality evaluation across the Big Data value chain consists of assessing first the quality of Big Data itself, which involve processes such as cleansing, filtering and approximation, and then thequality of process handling this Big Data, which involves for example processing and analytics process.

Big Data Pre-processing: A Quality Framework

A QBD model incorporating processes to support Data quality profile selection and adaptation is proposed and it tracks and registers on a data provenance repository the effect of every data transformation happened in the pre-processing phase.

Data quality in big data processing: Issues, solutions and open problems

  • Pengcheng ZhangFang XiongJ. GaoJimin Wang
  • Computer Science
    2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)
  • 2017
This paper uses recommendation systems and prediction systems as typical big data applications and tries to find out the data quality issues during data collection, data preprocessing, data storage and data analysis stages of big data processing.

A Data Quality in Use model for Big Data

Big Data Quality: A Survey

An across-the-board quality management framework is proposed describing the key quality evaluation practices to be conducted through the different Big Data stages and can be used to leverage the quality management and to provide a roadmap for Data scientists to better understand quality practices and highlight the importance of managing the quality.
...