A Machine Learning Dataset Prepared From the NASA Solar Dynamics Observatory Mission

  title={A Machine Learning Dataset Prepared From the NASA Solar Dynamics Observatory Mission},
  author={Richard Galvez and David F. Fouhey and Meng Jin and Alexandre Szenicer and Andr{\'e}s Mu{\~n}oz-Jaramillo and Mark C. M. Cheung and Paul J. Wright and Monica G. Bobra and Yang Liu and James Mason and Rajat Mani Thomas},
In this paper we present a curated dataset from the NASA Solar Dynamics Observatory (SDO) mission in a format suitable for machine learning research. Beginning from level 1 scientific products we have processed various instrumental corrections, downsampled to manageable spatial and temporal resolutions, and synchronized observations spatially and temporally. We illustrate the use of this dataset with two example applications: forecasting future EVE irradiance from present EVE irradiance and… 

Figures and Tables from this paper

Auto-Calibration of Remote Sensing Solar Telescopes with Deep Learning
A Convolutional Neural Network is developed that auto-calibrates SDO/AIA channels and corrects sensitivity degradation by exploiting spatial patterns in multi-wavelength observations to arrive at a self-calibration of (E)UV imaging instruments.
Attention‐Based Machine Vision Models and Techniques for Solar Wind Speed Forecasting Using Solar EUV Images
Extreme ultraviolet images taken by the Atmospheric Imaging Assembly on board the Solar Dynamics Observatory make it possible to use deep vision techniques to forecast solar wind speed—a difficult,
Solar Wind Prediction Using Deep Learning
Emanating from the base of the Sun's corona, the solar wind fills the interplanetary medium with a magnetized stream of charged particles whose interaction with the Earth's magnetosphere has space
Using U-Nets to Create High-Fidelity Virtual Observations of the Solar Corona
This work shows that deep learning applied to SDO data can be successfully used to create a high-fidelity virtual telescope that generates synthetic observations of the solar corona by image translation, and developed a deep neural network, structured as an encoder-decoder with skip connections (U-Net), that reconstructs the Sun's image of one instrument channel given temporally aligned images in three other channels.
Machine Learning in Heliophysics and Space Weather Forecasting: A White Paper of Findings and Recommendations
The authors of this white paper met on 16-17 January 2020 at the New Jersey Institute of Technology, Newark, NJ, for a 2-day workshop that brought together a group of heliophysicists, data providers, expert modelers, and computer/data scientists to shape a strategy for further developments in the field.
Using Multiple Instance Learning for Explainable Solar Flare Prediction
In this work we leverage a weakly-labeled dataset of spectral data from NASA’s IRIS satellite for the prediction of solar flares using the Multiple Instance Learning (MIL) paradigm. While standard
Simultaneous Multivariate Forecast of Space Weather Indices using Deep Neural Network Ensembles
A model based on long shortterm memory neural networks is proposed to learn the distribution of time series data with the capability to provide a simultaneous multivariate 27-day forecast of the space weather indices using time series as well as solar image data.
Learning the solar latent space: sigma-variational autoencoders for multiple channel solar imaging
A sigma-variational autoencoder is used to learn a latent space of solar images using the 12 channels taken by Atmospheric Imaging Assembly and the Helioseismic and Magnetic Imager instruments on-board the NASA Solar Dynamics Observatory to improve the forecasts of the F30 solar radio flux index.
SynthIA: A Synthetic Inversion Approximation for the Stokes Vector Fusing SDO and Hinode into a Virtual Observatory
A deep-learning system named SynthIA (Synthetic Inversion Approximation), that can enhance both missions by capturing the best of each instrument’s characteristics by mimics magnetograms from the higher spectral resolution Hinode/SOT-SP pipeline, but is derived from full-disk, high-cadence, and lower spectral-resolution SDO/HMI observations.
Proxy-based Prediction of Solar Extreme Ultraviolet Emission Using Deep Learning
High-energy radiation from the Sun governs the behavior of Earth’s upper atmosphere and such radiation from any planet-hosting star can drive the long-term evolution of a planetary atmosphere.


A large-scale solar dynamics observatory image dataset for computer vision applications
This resource compile SDO solar data into a single repository in order to provide the computer vision community with a standardized and curated large-scale dataset of several hundred thousand solar events found on high resolution solar images.
The Solar Dynamics Observatory (SDO)
The Solar Dynamics Observatory (SDO) was launched on 11 February 2010 at 15:23 UT from Kennedy Space Center aboard an Atlas V 401 (AV-021) launch vehicle. A series of apogee-motor firings lifted SDO
Solar Flare Prediction Using SDO/HMI Vector Magnetic Field Data with a Machine-Learning Algorithm
We attempt to forecast M-and X-class solar flares using a machine-learning algorithm, called Support Vector Machine (SVM), and four years of data from the Solar Dynamics Observatory's Helioseismic
Deep Learning Based Solar Flare Forecasting Model. I. Results for Line-of-sight Magnetograms
Solar flares originate from the release of the energy stored in the magnetic field of solar active regions, the triggering mechanism for these flares, however, remains unknown. For this reason, the
Initial Calibration of the Atmospheric Imaging Assembly (AIA) on the Solar Dynamics Observatory (SDO)
The Atmospheric Imaging Assembly (AIA) instrument onboard the Solar Dynamics Observatory (SDO) is an array of four normal-incidence reflecting telescopes that image the Sun in ten EUV and UV
Flare Prediction Using Photospheric and Coronal Image Data
This is the first attempt to predict solar flares using photospheric vector-magnetic field data as well as multiple wavelengths of image data from the chromosphere, transition region, and corona, and it points the way towards greater data integration across diverse sources in future work.
Machine Learning, Statistics, and Data Mining for Heliophysics
This book includes a collection of interactive Jupyter notebooks that walks the reader through the process of applying machine learning, statistics, and data mining techniques on various kinds of solar and space physics data sets to reproduce published results.
Prediction of Extreme Ultraviolet Variability Experiment (EVE)/Extreme Ultraviolet Spectro-Photometer (ESP) Irradiance from Solar Dynamics Observatory (SDO)/Atmospheric Imaging Assembly (AIA) Images Using Fuzzy Image Processing and Machine Learning
The cadence and resolution of solar images have been increasing dramatically with the launch of new spacecraft such as STEREO and SDO. This increase in data volume provides new opportunities for
Extreme Ultraviolet Variability Experiment (EVE) on the Solar Dynamics Observatory (SDO): Overview of Science Objectives, Instrument Design, Data Products, and Model Developments
The highly variable solar extreme ultraviolet (EUV) radiation is the major energy input to the Earth’s upper atmosphere, strongly impacting the geospace environment, affecting satellite operations,
The Atmospheric Imaging Assembly (AIA) on the Solar Dynamics Observatory (SDO)
The Atmospheric Imaging Assembly (AIA) provides multiple simultaneous high-resolution full-disk images of the corona and transition region up to 0.5 R⊙ above the solar limb with 1.5-arcsec spatial