Towards a Consistent Measurement Stream Processing from Heterogeneous Data Sources

@article{Divn2017TowardsAC,
  title={Towards a Consistent Measurement Stream Processing from Heterogeneous Data Sources},
  author={Mario Jos{\'e} Div{\'a}n and Mar{\'i}a de los {\'A}ngeles Mart{\'i}n},
  journal={International Journal of Electrical and Computer Engineering},
  year={2017},
  volume={7},
  pages={3164-3175},
  url={https://api.semanticscholar.org/CorpusID:1943629}
}
A new version of the measurement interchange schema based on the updated C-INCAMI framework was introduced, which incorporated the concept of “complementary data” linking them with geographic information.
View via Publisher
ijece.iaescore.com
16 Citations
Background Citations
6
Methods Citations
11

Figures from this paper

16 Citations

A new storm topology for synopsis management in the processing architecture

The storm topology associated with the online processing in PAbMM is described, a new synopses strategy for monitoring entities under analysis is presented and a new schema for training the online classifiers is introduced.

A Real-Time Data Processing based on Multilayer Windows and the Measurement Interchange Schema

    M. Diván
    Computer Science, Engineering
    2019 4th International Conference on Information…
  • 2019
A new strategy related to sliding logical windows is incorporated into the PAbMM_Win library, fostering processing alternatives jointly with the data interchange.

A Library for Articulating the Measurement Streams with Columnar Data

The CINCAMImisConversor library allows the data format conversion from the CINCAMI/MIS streams to the columnar organization and could translate 4900 measures in approximately 11 ms.

Strategy for the data monetization in tune with the data stream processing

In this invited talk, a strategy for the data monetization in tune with the data stream processing is shown and an application case for exposing the potential associated with the monetization strategy related to PAbMM is shown.

Towards a Stratified Multi-Criteria Decision-Making in the Real-Time Data Processing

An extension of this M&E framework is proposed for support the Stratified Multi-Criteria Decision-Making Method jointly with the updating of the architecture for supporting the indicator interpretation in different scenarios and entity’s states.

A Real-Time Atypical Amplitude Detection based on Measurement Metadata

    M. Diván
    Computer Science, Engineering
    2019 Amity International Conference on Artificial…
  • 2019
A new component oriented to detect an atypical amplitude on the data in real-time using the measurement metadata related to the project definition is introduced and incorporates a complement to the current outlier detection strategy.

Applying the Real-Time Monitoring based on Wireless Sensor Networks: The Bajo Giuliani Project

    M. Diván
    Environmental Science, Engineering
    2018 7th International Conference on Reliability…
  • 2018
The project’s aim is related to the monitoring of the water level in the “Bajo Giuliani” lagoon (La Pampa, Argentina) for supporting the data-driven decision making and avoiding the floods in the rain season.

Metadata-based measurements transmission verified by a Merkle Tree

A Real-Time Entity Monitoring based on States and Scenarios

A discrete simulation is introduced for describing the times and sizes associated with the new schema when the volume of the projects to update grow-up, allowing implementing scenarios and entity states to increase the suitability between indicators and decision criteria according to the current scenario and entity state under analysis.

Articulating heterogeneous data streams with the attribute-relation file format

The CincamimisConversor library allows exporting from the data streams organized under a measurement interchange schema to a columnar-data organization in real-time, and an extension to the library is introduced for supporting the real-time translating and storing from the heterogeneous data streams to the ARFF file format.

26 References

Process View for a Data Stream Processing Strategy based on Measurement Metadata

This work discusses the process formalization for its data stream processing components, and their interactions, based on the SPEM language, and the main specified activities ranges from data source configuration of heterogeneous data sources, to statistical analysis and classifiers for decision making.

Towards a Data Processing Architecture for the Weather Radar of the INTA Anguil

This paper proposes a processing architecture that extends the SDSPbMM to incorporate the processing of big data, which would provide theWR of a detective and predictive behavior on online data, as well as include a layer of public services, which encourages the consumption of data generated by the WR of INTA Anguil.

Processing architecture based on measurement metadata

A processing architecture specialized in the measurement and evaluation, based on the C-INCAMI framework, which uses a big data repository to make available the data for consumption and to manage an organizational memory, which allows a feedback mechanism in relation with online processing.

Strategy for Data Stream Processing Based on Measurement Metadata: An Outpatient Monitoring Scenario

SDSPbMM, an integrated Strategy for Data Stream Processing based on Measurement Metadata, applied to an outpatient monitoring scenario is discussed, and a simulation using a prototype developed for outpatient monitoring is performed, in order to analyze empirically processing times and variable scalability.

An Evaluation of Data Stream Processing Systems for Data Driven Applications

How to Measure and Evaluate Web Applications in a Consistent Way

The rationale to measure and evaluate software and web applications or products from different perspectives is analyzed and a measurement and evaluation framework that relies on a sound conceptual base is discussed.

Towards the Support of Contextual Information to a Measurement and Evaluation Framework

A model and a strategy for representing and using context information to the measurement and evaluation framework so-called INCAMI are proposed in order to assist in the recommendation of design solutions and in the interpretation of results.

Load adaptive and fault tolerant distributed stream processing system for explosive stream data

This paper proposes a distributed stream processing system which supports several load adaptation techniques utilizable for various circumstances of explosive data stream, and also supports fault tolerance mechanisms to fail over in several failure situations.

The Semantic Web Explained: The Technology and Mathematics behind Web 3.0

This book is intended to be a textbook about the Semantic Web and related topics, and is based on successful courses taught by the authors, and describes not only the theoretical issues underlying the semantic web, but also practical matters (such as algorithms, optimisation ideas and implementation details).

Learning Storm

This book starts from the basics of Storm and learns how to integrate Storm with other well-known Big Data technologies such as Hadoop, Redis, and Kafka to realize the full potential of Storm.