Image-Based Social Sensing: Combining AI and the Crowd to Mine Policy-Adherence Indicators from Twitter

  title={Image-Based Social Sensing: Combining AI and the Crowd to Mine Policy-Adherence Indicators from Twitter},
  author={Virginia Negri and Dario Scuratti and Stefano Agresti and Donya Rooein and Amudha Ravi Shankar and Jose Luis Fernandez Marquez and Mark James Carman and Barbara Pernici},
  journal={2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS)},
  • Virginia NegriDario Scuratti B. Pernici
  • Published 6 October 2020
  • Computer Science
  • 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS)
Social Media provides a trove of information that, if aggregated and analysed appropriately can provide important statistical indicators to policy makers. In some situations these indicators are not available through other mechanisms. For example, given the ongoing COVID-19 outbreak, it is essential for governments to have access to reliable data on policy-adherence with regards to mask wearing, social distancing, and other hard-to-measure quantities. In this paper we investigate whether it is… 

Analyzing social media with crowdsourcing in Crowd4SDG

The focus is on analyzing images and text contained in social media posts and a set of automatic data processing tools fortering, classification, and geolocation of content with a human-in-the-loop approach to support the data analyst.

The Effect of Twitter App Policy Changes on the Sharing of Spatial Information through Twitter Users

The results show, among others, that policy changes in 2015 and 2019 led users to post a smaller proportion of tweets with exact coordinates and that doubling the limit of allowable characters as part of the 2017 policy change increased the number of place names mentioned in tweets.

Extracting Large Scale Spatio-Temporal Descriptions from Social Media

The critical aspects of this investigation, such as event sensing, multilingualism, selection of visual evidence, and geolocation, are currently being studied as a foundation for a unified spatio-temporal representation of multi-modal descriptions.

TriggerCit: Early Flood Alerting using Twitter and Geolocation - a comparison with alternative sources

Rapid impact assessment in the immediate aftermath of a natural disaster is essential to provide adequate information to international organisations, local authorities, and first responders. Social

COVIDSensing: Social Sensing Strategy for the Management of the COVID-19 Crisis

A novel methodological tool based on social sensing, called COVIDSensing, serves to provide actionable information in real time for the management of the socio-economic and health crisis caused by COVID-19 and dynamically identifies socio- economic problems of general interest through the analysis of people's opinions on social networks.



A Survey of Techniques for Automatically Sensing the Behavior of a Crowd

It is found that despite the numerous reports in popular media, relatively few groups have been looking into practical solutions for sensing pedestrian behavior, and much work is still needed when it comes to combining privacy, transparency, scalability, and ease of deployment.

Talking about Places:Considering Context for the Geolocation of Images Extracted from Tweets

This paper introduces algorithms that take advantage of various contextual clues included in social media posts to help increase the proportion of posts that can be geolocated and investigates how to locate, in other social media, images that were originally embedded in tweets.

A Survey of Location Prediction on Twitter

An overall picture of location prediction on Twitter is offered, concentrating on the prediction of user home locations, tweet locations, and mentioned locations, which defines the three tasks and reviews the evaluation metrics.

E2mC: Improving Emergency Management Service Practice through Social Media and Crowdsourcing Analysis in Near Real Time

This paper sketches the developed system architecture, describes applicable scenarios and presents several preliminary case studies, providing evidence that the scientific and operational goals have been achieved, and improves the timeliness and accuracy of geospatial information products provided to civil protection authorities through leveraging user-generated data.

A visual–textual fused approach to automated tagging of flood-related tweets during a flood event

An automated flood tweets extraction approach by mining both visual and textual information a tweet contains by coupling CNN classification results with flood-sensitive words in tweets allows a significant increase in precision while keeps the recall rate in a high level.

A Technical Survey on Statistical Modelling and Design Methods for Crowdsourcing Quality Control

Exploratory Spatio-Temporal Queries in Evolving Information

This paper focuses on image extraction from social networks, in particular Twitter, in case of emergencies, and describes a scenario for rapid mapping in an emergency event and how information quality can evolve over time.

The Age of Social Sensing

Online social media have democratized the broadcasting of information, encouraging users to view the world through the lens of social networks, which presents challenges for researchers at the intersection of computer science and the social sciences.

Microsoft COCO: Common Objects in Context

We present a new dataset with the goal of advancing the state-of-the-art in object recognition by placing the question of object recognition in the context of the broader question of scene