Schema Independent Reduction of Streaming Log Data

  title={Schema Independent Reduction of Streaming Log Data},
  author={Theodoros Kalamatianos and Kostas Kontogiannis},
Large software systems comprise of different and tightly interconnected components. Such systems utilize heterogeneous monitoring infrastructures which produce log data at high rates from various sources and in diverse formats. The sheer volume of this data makes almost impossible the realor near real-time processing of these system logs. In this paper, we present a log schema independent approach that allows for the real time reduction of logged data based on a set of filtering criteria. The… CONTINUE READING