Towards Automated Log Parsing for Large-Scale Log Data Analysis

  title={Towards Automated Log Parsing for Large-Scale Log Data Analysis},
  author={Pinjia He and Jieming Zhu and Shilin He and Jian Li and Michael R. Lyu},
  journal={IEEE Transactions on Dependable and Secure Computing},
Logs are widely used in system management for dependability assurance because they are often the only data available that record detailed system runtime behaviors in production. Because the size of logs is constantly increasing, developers (and operators) intend to automate their analysis by applying data mining methods, therefore structured input data (e.g., matrices) are required. This triggers a number of studies on log parsing that aims to transform free-text log messages into structured… CONTINUE READING


Publications referenced by this paper.
Showing 1-10 of 40 references

A comparison of general-purpose distributed systems for data processing

  • J. Li
  • Proc. Int. Conf. Big Data, 2016, pp. 378–383.
  • 2016
1 Excerpt

Similar Papers

Loading similar papers…