Deep Learning Hyper-parameter Tuning for Sentiment Analysis in Twitter based on Evolutionary Algorithms

  title={Deep Learning Hyper-parameter Tuning for Sentiment Analysis in Twitter based on Evolutionary Algorithms},
  author={Eugenio Mart{\'i}nez-C{\'a}mara and Nuria Rodr{\'i}guez Barroso and Antonio R. Moya and Jos{\'e} Alberto Fern{\'a}ndez and Elena Romero and Francisco Herrera},
  journal={2019 Federated Conference on Computer Science and Information Systems (FedCSIS)},
The state of the art in Sentiment Analysis is defined by deep learning methods, and currently the research efforts are focused on improving the encoding of underlying contextual information in a sequence of text. However, those neural networks with a higher representation capacity are increasingly more complex, which means that they have more hyper-parameters that have to be defined by hand. We argue that the setting of hyper-parameters may be defined as an optimisation task, we thus claim that… 

Figures and Tables from this paper

Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis
A comprehensive comparative analysis of various hyperparameter tuning techniques is performed; these are Grid Search, Random Search, Bayesian Optimization, Particle Swarm Optimization (PSO), and Genetic Algorithm (GA) to optimize the accuracy of six machine learning algorithms.
Grid Search Tuning of Hyperparameters in Random Forest Classifier for Customer Feedback Sentiment Prediction
The experiments in this work show that the accuracy of the proposed model to predict the sentiment on customer feedback data is greater than the performance accuracy obtained by the model without applying parameter tuning.
Hyperparameter tuning of AdaBoost algorithm for social spammer identification
A hybrid modified whale optimization algorithm for spam profile detection (MWOA-SPD) model is proposed to find optimal values for hyperparameters to enhance the performance of spammer identification problem in online social networks.
Systematic literature review of sentiment analysis in the Spanish language
This study provides academics and professionals, a review of advances in Sentiment Analysis for the Spanish language, showing classification systems through three different approaches: Lexicon based, Machine Learning based and hybrid approaches.
An extensive analysis of online restaurant reviews: a case study of the Amazonian Culinary Tourism
The results show that professionals in this segment can use these analyzes in order to improve the user’s experiences and increase their profits.


Advanced Combined LSTM-CNN Model for Twitter Sentiment Analysis
  • Nan Chen, P. Wang
  • Computer Science
    2018 5th IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS)
  • 2018
An advanced model which is based on the LSTM-CNN model presented by Pedro M. Sosa for twitter sentiment analysis is proposed, which combined the encoder-decoder framework with the regular LSTm-CNN framework to make the features learning in CNN much more intrinsic and effective.
Combining lexicon-based and learning-based methods for twitter sentiment analysis
This paper proposes a new entity-level sentiment analysis method for Twitter that dramatically improves the recall and the F-score, and outperforms the state-of-the-art baselines.
Sentiment Analysis of Lithuanian Texts Using Traditional and Deep Learning Approaches
Traditional machine learning approaches were superior when compared to the deep learning methods; deep learning demonstrated good results when applied on the small datasets.
Self-Attention: A Better Building Block for Sentiment Analysis Neural Network Classifiers
It is demonstrated that SANs are superior in performance to their RNN and CNN counterparts by comparing their classification accuracy on six datasets as well as their model characteristics such as training speed and memory consumption.
NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets
In this paper, we describe how we created two state-of-the-art SVM classifiers, one to detect the sentiment of messages such as tweets and SMS (message-level task) and one to detect the sentiment of
RETUYT-InCo at TASS 2018: Sentiment Analysis in Spanish Variants using Neural Networks and SVM
This paper presents three approaches for classifying the sentiment of tweets for different Spanish variants in the TASS 2018 challenge, based on Support Vector Machines, Convolutional Neural Netowrks and Long Short Term Memory networks.
A multi-task neural network for multilingual sentiment classification and language detection on Twitter
Results show that the proposed convolutional neural network architecture outperforms both single-task and multi-task state-of-the-art approaches for classifying multilingual tweets.
BB_twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs
This attempt at producing a state-of-the-art Twitter sentiment classifier using Convolutional Neural Networks (CNNs) and Long Short Term Memory (LSTMs) networks using a large amount of unlabeled data to pre-train word embeddings.
Sentiment Analysis on Twitter
This paper proposes and investigates a paradigm to mine the sentiment from a popular real-time microblogging service, Twitter, where users post real time reactions to and opinions about “about” and “everything”.
Convolutional Neural Networks for Sentence Classification
The CNN models discussed herein improve upon the state of the art on 4 out of 7 tasks, which include sentiment analysis and question classification, and are proposed to allow for the use of both task-specific and static vectors.