Next-Generation Optical Sensing Technologies for Exploring Ocean Worlds—NASA FluidCam, MiDAR, and NeMO-Net

  title={Next-Generation Optical Sensing Technologies for Exploring Ocean Worlds—NASA FluidCam, MiDAR, and NeMO-Net},
  author={Ved Chirayath and Alan S. Li},
  journal={Frontiers in Marine Science},
  • V. Chirayath, Alan S. Li
  • Published 5 September 2019
  • Environmental Science, Mathematics
  • Frontiers in Marine Science
We highlight three emerging NASA optical technologies that enhance our ability to remotely sense , analyze, and explore ocean worlds – FluidCam and fluid lensing, MiDAR, and NeMO-Net. Fluid lensing is the first remote sensing technology capable of imaging through ocean waves without distortions in 3D at sub-cm resolutions. Fluid lensing and the purpose-built FluidCam CubeSat instruments have been used to provide refraction-corrected 3D multispectral imagery of shallow marine systems from… 
NASA NeMO-Net - A Neural Multimodal Observation & Training Network for Marine Ecosystem Mapping at Diverse Spatiotemporal Scales
We present NeMO-Net, the first open-source fully convolutional neural network (FCNN) and interactive learning and training software aimed at assessing the present and past dynamics of shallow marine
Design and Performance Evaluation of Multispectral Sensing Algorithms on CPU, GPU, and FPGA
Multispectral, Imaging, Detection, and Active Reflectance (MiDAR) is a method capable of imaging through ocean waves without distortion in 3D at sub-cm resolutions to sense living and non-living
Sunflower: locating underwater robots from the air
This work presents the first demonstration of wireless, 3D localization across the air-water interface - eliminating the need for additional infrastructure on the water surface and enabling aerial drones to directly locate underwater robots.
NASA NeMO-Net's Convolutional Neural Network: Mapping Marine Habitats with Spectrally Heterogeneous Remote Sensing Imagery
An object-based fully convolutional network (FCN) is developed to improve upon the spatial-spectral classification problem inherent in multimodal datasets and it is shown that with training upon augmented data in conjunction with classical methods, the network was able to achieve better overall classification and segmentation results.
Living up to the Hype of Hyperspectral Aquatic Remote Sensing: Science, Resources and Outlook
Intensifying pressure on global aquatic resources and services due to population growth and climate change is inspiring new surveying technologies to provide science-based information in support of
Ocean Sciences Across the Solar System
Exploration of the solar system has revealed multiple worlds with extensive liquid water oceans, which stand as potential targets in a search of evidence of life beyond Earth. Our understanding of
Structure-from-Motion on shallow reefs and beaches: potential and limitations of consumer-grade drones to reconstruct topography and bathymetry
Reconstructing the topography of shallow underwater environments using Structure-from-Motion—Multi View Stereo (SfM-MVS) techniques applied to aerial imagery from Unmanned Aerial Vehicles (UAVs) is
NeMO-Net – Gamifying 3D Labeling of Multi-Modal Reference Datasets to Support Automated Marine Habitat Mapping
A citizen science approach to create these training datasets through a novel 3D classification game for mobile and desktop devices and outlines the 3D labeling technique developed to accurately label complex coral reef imagery, to overcome the inherent variability of citizen science.
Learning from Synthetic Data: Enhancing Refraction Correction Accuracy for Airborne Image-Based Bathymetric Mapping of Shallow Coastal Waters
The increasing need for accurate bathymetric mapping is essential for a plethora of offshore activities. Even though aerial image datasets through Structure from Motion (SfM) and Multi-View Stereo
Emulating and Verifying Sensing, Computation, and Communication in Distributed Remote Sensing Systems
This paper presents updates to the Virtual Constellation Engine (VCE), a simulator and emulator which enables modeling of sensing, computation, and communication of multi-platform remote sensing


Drones that see through waves – preliminary results from airborne fluid lensing for centimetre-scale aquatic conservation
The use of fluid lensing technology on unmanned aerial vehicles (UAVs, or drones) is presented as a novel means for 3D imaging of aquatic ecosystems from above the water's surface at the centimetre
Use of Multi-Spectral High Repetition Rate LED Systems for High Bandwidth Underwater Optical Communications, and Communications to Surface and Aerial Systems
The development of high repetition rate multispectral LED optical systems initially developed for imaging, but also capable of simultaneous data transmission at rates of $\sim 100$ kbps are discussed.
Large area 3D reconstructions from underwater surveys
This work presents a complete and validated system for processing optical images acquired from an underwater robotic vehicle to form a 3D reconstruction of the ocean floor and presents results with ground-truth for structure as well as results from an oceanographic survey over a coral reef.
Active spectral imaging
VOLUME 14, NUMBER 1, 2003 LINCOLN LABORATORY JOURNAL 131 M   imaging systems, operated from ground-, airborne-, and space-based platforms, have found a variety of civilian
End of the chain? Rugosity and fine-scale bathymetry from existing underwater digital imagery using structure-from-motion (SfM) technology
The application of structure-from-motion (SfM) photogrammetry is demonstrated to generate high-resolution, three-dimensional bathymetric models of a fringing reef from existing underwater video collected to characterize the seafloor, providing finer-scale measurements of bathymetry and rugosity that are more applicable to ecological studies of coral reefs than provided by the more expensive and time-consuming geophysical methods.
Development of long range color imaging for wide area 3D reconstructions of the seafloor
3D visual mapping of the seafloor has found applications ranging from environment monitoring and survey of marine minerals to underwater archeology and inspection of modern man-made structures.
The next Landsat satellite: The Landsat Data Continuity Mission
Optical Design of a Reflecting Telescope for CubeSat
Space telescope optics is one of the major parts of any space mission used to observe astronomical targets or the Earth. This kind of space mission typically involves bulky and complex opto-mechanics
Abstract. Airborne laser scanning (ALS) is a widely used technique for the sampling of the earth's surface. Next to the widely used geometric information current systems provide additional