Knowledge extraction from maritime spatiotemporal data: An evaluation of clustering algorithms on Big Data

  title={Knowledge extraction from maritime spatiotemporal data: An evaluation of clustering algorithms on Big Data},
  author={Giannis Spiliopoulos and Konstantinos Chatzikokolakis and Dimitrios Zissis and Evmorfia Biliri and Dimitrios Papaspyros and Giannis Tsapelas and Spyros Mouzakitis},
  journal={2017 IEEE International Conference on Big Data (Big Data)},
In this paper we attempt to define the major trade routes which vessels of trade follow when travelling across the globe in a scalable, data-driven unsupervised way. For this, we exploit a large volume of historical AIS data, so as to estimate the location and connections of the major trade routes, with minimal reliance on other sources of information. We address the challenges posed due to the volume of data by leveraging distributed computing techniques and present a novel MapReduce based… 

Figures and Tables from this paper

Distributed Execution of Spatial SQL Queries
This paper presents an implementation that enables spatial support for distributed execution of spatial SQL queries as part of the system Exareme, and evaluates some of the State-of-the-Art existing geospatial distributed systems.
Big maritime data for the Baltic Sea with a focus on the winter navigation system
Preliminary Inter-comparison of AIS Data and Optimal Ship Tracks
In this exercise, VISIR is fed by wave analysis fields from the Copernicus Marine Environment Monitoring Service (CMEMS) in order to reproduce vessel speed loss in waves, where kinematic information from AIS is fusioned with wave information from CMEMS.
Robust Marine Buoy Placement for Ship Detection Using Dropout K-Means
This paper formulate marine buoy placement as a clustering problem, and proposes dropout k-means and drop out k-median to improve placement robustness to buoy disruption.
A Methodology to Evaluate the Effectiveness of Intelligent Ship Navigational Information Monitoring System
A comprehensive evaluation methodology is proposed to evaluate the effectiveness of intelligent ship navigational information monitoring system by analyzing the information behavior processes in this proposed system and the available information monitoring technologies applied on intelligent ships.


Using machine learning for unsupervised maritime waypoint discovery from streaming AIS data
This paper aims to capture the characteristics of maritime routes for a specific region in the form of a directed graph, which can be used as a foundation for predicting destination and arrival time of each associated vessel and presents a hybrid approach and its ability to discover waypoints.
Vessel Pattern Knowledge Discovery from AIS Data: A Framework for Anomaly Detection and Route Prediction
An unsupervised and incremental learning approach to the extraction of maritime movement patterns is presented here to convert from raw data to information supporting decisions, and is a basis for automatically detecting anomalies and projecting current trajectories and patterns into the future.
Clustering Big Spatiotemporal-Interval Data
A new energy function is used to measure similarity and balance between clusters in spatial and temporal dimensions to address spatiotemporal interval data clustering problem.
Visualization of vessel movements
A geographical visualization to support operators of coastal surveillance systems and decision making analysts to get insights in vessel movements as an overlay on a map based on density fields derived from convolution of the dynamic vessel positions with a kernel.
Discovering vessel activities at sea using AIS data: Mapping of fishing footprints
A method that automatically extracts knowledge from ship reporting positioning data is proposed that is applicable to the practical scenario of automatically discovering fishing areas based on historical AIS data broadcast by fishing vessels.
Data clustering: 50 years beyond K-means
Improving Fishing Pattern Detection from Satellite AIS Using Data Mining and Machine Learning
This study presents the first comprehensive approach to detect and identify potential fishing behavior for three major gear types operating on a global scale, and hopes that this work will enable new efforts to assess the spatial and temporal distribution of global fishing effort and make global fisheries activities transparent to ocean scientists, managers and the public.