Conceptual modeling for ETL processes

@inproceedings{Vassiliadis2002ConceptualMF,
  title={Conceptual modeling for ETL processes},
  author={Panos Vassiliadis and Alkis Simitsis and Spiros Skiadopoulos},
  booktitle={DOLAP '02},
  year={2002}
}
Extraction-Transformation-Loading (ETL) tools are pieces of software responsible for the extraction of data from several sources, their cleansing, customization and insertion into a data warehouse. In this paper, we focus on the problem of the definition of ETL activities and provide formal foundations for their conceptual representation. The proposed conceptual model is (a) customized for the tracing of inter-attribute relationships and the respective ETL activities in the early stages of a… 
A Methodology for the Conceptual Modeling of ETL Processes
TLDR
A methodology for the earliest stages of the data warehouse design is proposed, with the goal of tracing the analysis of the structure and content of the existing data sources and their intentional mapping to the common conceptual data warehouse model.
Modeling and managing ETL processes
TLDR
This research delve into the modeling of ETL activities and provides a conceptual and a logical abstraction for the representation of these processes, and focuses on the optimization of the ETL processes, in order to minimize the execution time of an ETL process.
Towards a Framework for Conceptual Modeling of ETL Processes
TLDR
This paper presents the approach, which is based on a framework for modeling ETL processes, and offers support and guideline to the designer, and has the advantage to use a shorten notation, to design an ETL, consisting mainly on three components.
A method for the mapping of conceptual designs to logical blueprints for ETL processes
Modeling ETL activities as graphs
TLDR
This paper focuses on the logical design of the ETL scenario of a data warehouse, which is based on a formal logical model that includes the data stores, activities and their constituent parts as a graph, which it is called the Architecture Graph.
Mapping conceptual to logical models for ETL processes
TLDR
This paper describes the mapping of the conceptual to the logical model, and identifies how a conceptual entity is mapped to a logical entity and determines the execution order in the logical workflow using information adapted from the conceptual model.
An approach to conceptual modelling of ETL processes
  • Sasa Dupor, V. Jovanovic
  • Computer Science
    2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)
  • 2014
TLDR
A new conceptual model based on the visualization of data flow showing transformations of records accompanied with attribute transformations is proposed, which can be used for development of an ETL process, maintenance/optimization and redesign of a process due to new business requirements and database schema changes.
CommonCube-based conceptual modeling of ETL processes
TLDR
A novel conceptual model for the modeling of ETL processes is proposed, which defines ETL mappings 1:0 capture the semantics of various relationship cardinalities between source attributes and target attributes, which provide a good basis for the design ofETL processes.
A taxonomy of ETL activities
TLDR
A black-box approach is followed and a taxonomy that characterizes ETL activities in terms of the relationship of their input to their output is provided and it is shown how the proposed taxonomy can be used in the construction of larger modules, i.e., ETL archetype patterns, which are used for the composition and optimization of ETL workflows.
Using Perspective Schemata to Model the ETL Process
TLDR
This paper presents the overview of the proposed framework to model the ETL process, which is based on the use of a reference model and perspective schemata, which provides the designer with a better understanding of the semantic associated with theETL process.
...
...

References

SHOWING 1-10 OF 64 REFERENCES
Modeling ETL activities as graphs
TLDR
This paper focuses on the logical design of the ETL scenario of a data warehouse, which is based on a formal logical model that includes the data stores, activities and their constituent parts as a graph, which it is called the Architecture Graph.
A Principled Approach to Data Integration and Reconciliation in Data Warehousing
TLDR
This work describes a novel approach to data integration and reconciliation, based on a conceptual representation of the Data Warehouse application domain, to declaratively specify suitable matching, conversion, and reconciliation operations to be used in order to solve possibile conflicts among data in different sources.
Modeling the Data Warehouse Refreshment Process as a Workflow Application
TLDR
It is shown that the refreshment process is more complex than the view maintenance problem, and different from the loading process.
The Dimensional Fact Model: A Conceptual Model for Data Warehouses
TLDR
This paper formalizes a graphical conceptual model for data warehouses, called Dimensional Fact model, and proposes a semi-automated methodology to build it from the pre-existing schemes describing the enterprise relational database.
A methodological framework for data warehouse design
TLDR
This paper outlines a general methodological framework for data warehouse design, based on the Dimensional Fact Model (DFM), which suggests that conceptual design is carried out semi-automatically starting from the operational database scheme.
Design and Analysis of Quality Information for Data Warehouses
TLDR
An approach to assess the quality of the data warehouse via a semantically rich model of quality management in a data warehouse, which allows stakeholders to design abstract quality goals that are translated to executable analysis queries on quality measurements in the data Warehouse's meta database.
starER: a conceptual model for data warehouse design
TLDR
This paper argues that, in order to accurately reflect the users requirements into an error-free, understandable, and easily extendable data warehouse schema, special attention should be paid at the conceptual modeling phase.
...
...