Bigdata Analysis: Streaming Twitter Data with Apache Hadoop and Visualizing using BigInsights

@article{Danthala2015BigdataAS,
  title={Bigdata Analysis: Streaming Twitter Data with Apache Hadoop and Visualizing using BigInsights},
  author={Manoj Kumar Danthala and Siddhartha Ghosh},
  journal={International journal of engineering research and technology},
  year={2015},
  volume={4}
}
Nowadays the term big data becomes the buzzword in every organization due to ever-growing generation of data every day in life. The amount of data in industries has been increasing and exploding to high rates-so-called big data. The use of big data will become a key basis of competition and growth for individual firms. It is difficult to process and stream the big data within the specified resources. So the simple and easy way to solve the problem of big data is with Hadoop which processes the… 

Figures from this paper

SOCIAL NETWORKSBASED DISEASE ANALYSIS USING HADOOP
TLDR
This paper aims to analyse social media (Twitter,etc.) big data to identify the widespread of certain keywords related to different diseases at various locations such as India, TamilNadu and World.
Opinion Mining of Twitter Data using Hadoop and Apache Pig
TLDR
This paper provides an efficient mechanism to perform opinion mining by coming up with a finish to finish pipeline with the assistance of Apache Flume, Apache HDFS, and Apache Pig.
Location based Analysis of Twitter Data using Apache Hive
TLDR
This paper discusses how to use FLUME for extracting twitter data and store it into HDFS for analysis, and after that it is use apache hive for analysing these data.
An Exploratory Survey of Hadoop Log Analysis Tools
TLDR
This paper aims to explore more about Hadoop Log Analysis tools and how they can assist with technological breakthroughs, and an exploratory assessment of these tools is presented in this paper.
Opinion Mining of Twitter Data using Hive
TLDR
This paper provides an efficient mechanism to perform opinion mining by coming up with a finish to finish pipeline with the assistance of Apache Flume ,Apache HDFS, and Apache Hive.
An Exploratory Survey of Hadoop Log Analysis Tools
TLDR
An exploratory assessment of the different log analyzers used for failure detection and monitoring in Hadoop is presented.
Multilingual Sentiment Analysis on Twitter dataset using Naive Bayes Algorithm
TLDR
This paper presents the analysis of sentiments of 4 languages tweets by applying Naïve Bayes algorithm and effectively identify the sentiments of the users by utilizing their twitter walls comments and posts.
Multilingual Sentimental Analysis on Twitter Dataset: A Review
TLDR
This work surveys various techniques which can be utilized to examine these multilingual proclamation accurately and concludes that absence of clear grammatical structure it is exceptionally hard to discover correct sentiment out of it.
A neural attention based approach for clickstream mining
TLDR
A Multi-View learning (MVL) framework that predicts whether users would make a purchase or not by analyzing their clickstreams is developed and a well informed undersampling strategy using autoencoders is proposed that resulted in much improved f-scores.
A new approach to crowd journalism using a blockchain-based infrastructure
TLDR
This work introduces a Crowd Journalism ecosystem whose core is a video marketplace web tool based on an organization-level decentralized system that can store, visualize, rate, and execute transactions of live-made videos.

References

SHOWING 1-7 OF 7 REFERENCES
Sentiment Analysis of Twitter Data Using Hadoop
TLDR
This project proposes to analyse the sentiments of Twitter users through their tweets in order to extract what they think using hadoop for sentiment analysis which will process the huge amount of data on a hadoop cluster faster.
A, Effective Sentiment Analysis on Twitter Data using: Apache Flume and Hive
  • Computer Science and EngineeringDept
Dirk deRoos -Understanding Big Data‖
    The sentence punctuation follows the bracket
      Understanding the Big Data problems and their solutions using Hadoop MapReduce
        Kale , Prof . Sangram S . Dandge , Understanding the Big Data problems and their solutions using Hadoop MapReduce
        • GSuresh Babu . A , Effective Sentiment Analysis on Twitter Data using : Apache Flume and Hive , Computer Science and EngineeringDept , JNTUACEP , Pulivendula
        Radar Team, Planning for Big data, A CIO's Handbook to changing the Data Landscape