Detection of Flooding Events in Social Multimedia and Satellite Imagery using Deep Neural Networks
@inproceedings{Bischke2017DetectionOF, title={Detection of Flooding Events in Social Multimedia and Satellite Imagery using Deep Neural Networks}, author={Benjamin Bischke and Prakriti Bhardwaj and Aman Gautam and Patrick Helber and Damian Borth and Andreas R. Dengel}, booktitle={MediaEval}, year={2017} }
This paper presents the solution of the DFKI-team for the Multimedia Satellite Task at MediaEval 2017. [] Key Method Additionally, we extend existing network architectures for semantic segmentation to incorporate RGB and Infrared (IR) channels into the model. Our results show that IR information is of vital importance for the detection of flooded areas in satellite imagery.
50 Citations
Detecting Flooding in Social Media Imagery Using Multimodal Deep Learning
- Computer Science, Environmental Science
- 2021
This work explores multimodal deep learning approaches to flood identification in social media images by means of image-metadata fusion and finds that CNNor LSTM-based metadata models do not rival the well-performing baseline image model given the modest size of the available metadata-set.
Fusing Visual Features and Metadata to Detect Flooding in Flickr Images
- Computer Science2020 Digital Image Computing: Techniques and Applications (DICTA)
- 2020
A novel backpropagation technique, Direct Back Propagation (DBP) is used to train a neural network for the classification of flood images in the MediaEval 2017 dataset, showing that the fusion methods improve the classification accuracy compared to their individual counterparts.
Deep Learning Models for Estimation of Flood Severity Using Multimodal and Satellite Images
- Computer ScienceMediaEval
- 2019
This paper addresses the Multimedia Satellite Task at MediaEval 2019 by discussing about the performance of proposed CNN models and pre-trained models in the context of binary classification of images for flood related data.
Assessing flood severity from crowdsourced social media photos with deep neural networks
- Computer Science, Environmental ScienceMultimedia Tools and Applications
- 2020
This paper evaluates the use of deep convolutional neural networks for discriminating images showing direct evidence of a flood, and estimating the severity of the flooding event, concluding that these classification models can achieve a very high accuracy on this task.
Global-Local Feature Fusion for Image Classification of Flood Affected Roads from Social Multimedia
- Computer ScienceMediaEval
- 2018
It is shown that local features of objects can be efficiently used for road passability classification and achieve similar good results with local features as with global features.
Ensembled Convolutional Neural Network Models for Retrieving Flood Relevant Tweets
- Computer ScienceMediaEval
- 2018
A supervised learning method with an ensemble of 10 Convolutional Neural Networks was applied to classify the tweets in the benchmark to present a method proposed by team EVUSikg for the MediaEval 2018 challenge on Multimedia Satellite Task.
AI-based flood event understanding and quantification using online media and satellite data
- Computer Science, Mathematics
- 2019
This work aims to detect floods and also give relevant information about the flood situation such as the water level and the extension of the flooded regions, as specified in the three subtasks, for which of them a specific solution is proposed.
Deep Learning Approaches for Flood Classification and Flood Aftermath Detection
- Computer ScienceMediaEval
- 2018
This paper presents the method proposed by team UTAOS for MediaEval 2018 Multimedia Satellite Task: Emergency Response for Flooding Events. In the first challenge, we mainly rely on object and scene…
VRBagged-Net: Ensemble Based Deep Learning Model for Disaster Event Classification
- Computer Science
- 2021
The VRBagged-Net with a slight modification also ranked first in the flood-related Multimedia Task at the MediaEval Workshop 2020 and exceeds the previous best result by producing an F1 evaluation of 93.76.
Automatic detection of passable roads after floods in remote sensed and social media data
- Computer ScienceSignal Process. Image Commun.
- 2019
References
SHOWING 1-10 OF 13 REFERENCES
The Multimedia Satellite Task at MediaEval 2018
- Environmental ScienceMediaEval
- 2017
The MediaEval 2018 Multimedia Satellite Task focuses on flooding events and consists of two subtasks that seek to go beyond state-of-the-art flooding map generation by focusing on information about road passability and the accessibility of urban infrastructure.
Contextual Enrichment of Remote-Sensed Events with Social Media Streams
- Environmental ScienceACM Multimedia
- 2016
This work presents a scalable system for the contextual enrichment of satellite images by crawling and analyzing multimedia content from social media and uses Twitter as main data source and analyzes its textual, visual, temporal, geographical and social dimensions.
Overview of ImageCLEF 2017 Population Estimation (Remote) task
- Environmental ScienceCLEF
- 2017
This paper presents the results that were obtained by the participants of the Population Estimation (or Remote) task as well as a brief summary of some of the approaches that were used.
The JORD System: Linking Sky and Social Multimedia Data to Natural Disasters
- Computer ScienceICMR
- 2017
This paper presents a system called JORD that is able to autonomously collect social media data about technological and environmental disasters, and link it automatically to remote-sensed data, and demonstrates that queries in local languages that are relevant to the exact position of natural disasters retrieve more accurate information about a disaster event.
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification
- Environmental Science, Computer ScienceIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- 2019
A patch-based land use and land cover classification approach using Sentinel-2 satellite images that covers 13 spectral bands and is comprised of ten classes with a total of 27 000 labeled and geo-referenced images is presented.
Fully convolutional networks for semantic segmentation
- Computer Science2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2015
The key insight is to build “fully convolutional” networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning.
DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networks
- Computer ScienceArXiv
- 2014
Performance evaluation shows the newly trained deep CNNs model SentiBank 2.0 (or called DeepSentiBank) is significantly improved in both annotation accuracy and retrieval performance, compared to its predecessors which mainly use binary SVM classification models.
Introducing the Sky and the Social Eye
- Computer ScienceMediaEval
- 2016
The Sky and the Social Eye task was run for the first time as a Grand Challenge at the 2016 ACM Multimedia Conference and as a Task Force at the2016 MediaEval Workshop to create a richer user experience.
Very Deep Convolutional Networks for Large-Scale Image Recognition
- Computer ScienceICLR
- 2015
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
Deep Residual Learning for Image Recognition
- Computer Science2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2016
This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth.