Protest Activity Detection and Perceived Violence Estimation from Social Media Images

@article{Won2017ProtestAD,
  title={Protest Activity Detection and Perceived Violence Estimation from Social Media Images},
  author={Donghyeon Won and Zachary C. Steinert-Threlkeld and Jungseock Joo},
  journal={Proceedings of the 25th ACM international conference on Multimedia},
  year={2017}
}
We develop a novel visual model which can recognize protesters, describe their activities by visual attributes and estimate the level of perceived violence in an image. [...] Key Method We have collected geotagged tweets and their images from 2013-2017 and analyzed multiple major protest events in that period. A multi-task convolutional neural network is employed in order to automatically classify the presence of protesters in an image and predict its visual attributes, perceived violence and exhibited emotions…Expand
Violence Detection in Social Media-Review
Social media has become a vital part of humans’ day to day life. Different users engage with social media differently. With the increased usage of social media, many researchers have investigatedExpand
Application of Sentiment Lexicons on Movies Transcripts to Detect Violence in Videos
TLDR
The research work reports performance of two different sentiment lexicons when they were applied on video transcripts to detect violence in YouTube videos, using the existing sentiment lexicon models. Expand
Social and Political Event Analysis based on Rich Media
This tutorial aims to provide a comprehensive overview on the applications of rich social media data for real world social and political event analysis, which is a new emerging topic in multimediaExpand
CASM: A Deep-Learning Approach for Identifying Collective Action Events with Text and Image Data from Social Media
Protest event analysis is an important method for the study of collective action and social movements and typically draws on traditional media reports as the data source. We introduce collectiveExpand
Understanding Gender Stereotypes and Electoral Success from Visual Self-presentations of Politicians in Social Media
Social media have been widely used as a platform for political communication, promoting firsthand dialogue between politicians and the public. This paper studies the role of visual self-presentationExpand
Understanding social media beyond text: a reliable practice on Twitter
Social media provides high-volume and real-time data, which has been broadly used in diverse applications in sales, marketing, disaster management, health surveillance, etc. However, distinguishingExpand
Understanding the Political Ideology of Legislators from Social Media Images
TLDR
Using deep learning techniques to automatically predict Republican or Democratic party affiliation solely from the Facebook photographs of the members of the 114th U.S. Congress, it is demonstrated that predicted class probabilities from the model function as an accurate proxy of the political ideology of images along a left-right (liberal-conservative) dimension. Expand
Suspicious Local Event Detection in Social Media and Remote Sensing: Towards a Geosocial Dataset Construction
TLDR
An insight into the present state of knowledge is provided to better address the task of local suspicious event detection and linking social media with satellite imagery and how to use the available geo-locations in the dataset to construct a geo-social dataset. Expand
Image as Data: Automated Visual Content Analysis for Political Science
TLDR
An in-depth overview of automated methods for visual content analysis based on computer vision and deep learning is offered and how these methods can contribute to the study of political communication, identity and politics, development, and conflict, by enabling a new set of research questions at scale. Expand
Prototyping a Social Media Flooding Photo Screening System Based on Deep Learning
TLDR
A prototype screening system to identify flooding-related photos from social media using a convolutional neural network developed and trained to detect flooding photos, designed in a way that the CNN can be re-trained by a larger training dataset when more analyst-verified flooding photos are being added to the training set in an iterative manner. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 57 REFERENCES
Identifying violent protest activity with scalable machine learning ∗
The outbreak and frequency of violent protest activity since 2010 has been a cause for alarm among policy makers and the public at large and has renewed interest in the study of violent forms ofExpand
Violence Detection in Movies
TLDR
An algorithm to detect violent scene in movies is proposed that works reasonably well in detecting most of the violent scenes and is computationally simple yet effective. Expand
Violent flows: Real-time detection of violent crowd behavior
TLDR
A novel approach to real-time detection of breaking violence in crowded scenes by considers statistics of how flow-vector magnitudes change over time, using the VIolent Flows descriptor. Expand
Violence Detection in Video Using Spatio-Temporal Features
TLDR
A violence detector built on the concept of visual codebooks using linear support vector machines is presented, confirming that motion patterns are crucial to distinguish violence from regular activities in comparison with visual descriptors that rely solely on the space domain. Expand
Violence Detection in Video Using Computer Vision Techniques
TLDR
A new video database containing 1000 sequences divided in two groups: fights and non-fights is introduced and experiments show that fights can be detected with near 90% accuracy. Expand
A Multifaceted Approach to Social Multimedia-Based Prediction of Elections
TLDR
A new model, named competitive vector auto regression (CVAR), is presented to build a reliable forecasting system for the US presidential elections and US House race, designed to analyze the correlation between image-centric social multimedia and real-world phenomena. Expand
Visual Persuasion: Inferring Communicative Intents of Images
TLDR
This study demonstrates that a systematic focus on visual persuasion opens up the field of computer vision to a new class of investigations around mediated images, intersecting with media analysis, psychology, and political communication. Expand
The Critical Periphery in the Growth of Social Protests
TLDR
This work analyzes three datasets tracking protest communication in different languages and political contexts through the social media platform Twitter and employs a network decomposition technique to examine their hierarchical structure, providing consistent evidence that peripheral participants are critical in increasing the reach of protest messages and generating online content at levels that are comparable to core participants. Expand
Social Event Classification via Boosted Multimodal Supervised Latent Dirichlet Allocation
TLDR
The proposed BMM-SLDA can effectively exploit the multimodality and the multiclass property of social events jointly, and make use of the supervised category label information to classify multiclass social event directly, and is suitable for large-scale data analysis by utilizing boosting weighted sampling strategy to iteratively select a small subset of data to efficiently train the corresponding topic models. Expand
Social event detection using multimodal clustering and integrating supervisory signals
TLDR
A novel multimodal clustering algorithm that achieves superior clustering accuracy and additionally requires the specification of a much smaller number of parameters is proposed. Expand
...
1
2
3
4
5
...