Dynamic Load Balancing Method for Apache Flume Log Processing

  title={Dynamic Load Balancing Method for Apache Flume Log Processing},
  author={U K Han and JinHo Ahn},
Recently, as web log data their users leave daily rapidly emerge as valuable assets for web service companies, designing log aggregator for collecting these log data in an efficient manner is also getting high attention in big data analytics research. However, we observe a representative data aggregator, Apache Flume, used for this purpose has some drawbacks on evenly distributing incoming log workload on collector agents. In this paper, we propose a new load balancing method to overcome this… CONTINUE READING


Publications referenced by this paper.
Showing 1-6 of 6 references

Avro client should be able to use load balancing RPC

  • Mike Percy
  • Web Page,
  • 2012

Apache Hadoop project , Web Page Apache Flume 1 . 4 . 0 User Guide , Web Page

  • Gendreau
  • , A Distributed Drafting Algorithm for Load…

Similar Papers

Loading similar papers…