Corpus ID: 219721219

Deep Learning with Functional Inputs

  title={Deep Learning with Functional Inputs},
  author={Barinder Thind and Kevin Multani and Jiguo Cao},
We present a methodology for integrating functional data into deep densely connected feed-forward neural networks. The model is defined for scalar responses with multiple functional and scalar covariates. A by-product of the method is a set of dynamic functional weights that can be visualized during the optimization process. This visualization leads to greater interpretability of the relationship between the covariates and the response relative to conventional neural networks. The model is… Expand
FuncNN: An R Package to Fit Deep Neural Networks Using Generalized Input Spaces
Several functions are introduced that provide users an avenue to easily build models, generate predictions, and run cross-validations and the ultimate contribution is a package that provides a set of general modelling and diagnostic tools for data problems in which there exist both functional and scalar covariates. Expand
Neural Networks as Functional Classifiers
This work extends notable deep learning methodologies to the domain of functional data for the purpose of classification problems and demonstrates the effectiveness of the method in a number of classification applications such as classification of spectrographic data. Expand


Functional multi-layer perceptron: a non-linear tool for functional data analysis
This paper studies a natural extension of multi-layer perceptrons (MLP) to functional inputs and obtains universal approximation results that show the expressive power of functional MLP is comparable to that of numerical MLP. Expand
Functional Regression
Functional data analysis (FDA) involves the analysis of data whose ideal units of observation are functions defined on some continuous domain, and the observed data consist of a sample of functionsExpand
Adam: A Method for Stochastic Optimization
This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework. Expand
Semi-functional partial linear regression
This note deals with the problem of predicting some real-valued response variable in the situation where some among the explanatory variables are functional. More precisely, a new model is introducedExpand
Dropout: a simple way to prevent neural networks from overfitting
It is shown that dropout improves the performance of neural networks on supervised learning tasks in vision, speech recognition, document classification and computational biology, obtaining state-of-the-art results on many benchmark data sets. Expand
Deep Residual Learning for Image Recognition
This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. Expand
Generalized functional linear models
We propose a generalized functional linear regression model for a regression situation where the response variable is a scalar and the predictor is a random function. A linear predictor is obtainedExpand
ImageNet classification with deep convolutional neural networks
A large, deep convolutional neural network was trained to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes and employed a recently developed regularization method called "dropout" that proved to be very effective. Expand
Statistical Computing in Functional Data Analysis: The R Package fda.usc
This paper is devoted to the R package fda.usc which includes some utilities for functional data analysis. This package carries out exploratory and descriptive analysis of functional data analyzingExpand
Nonparametric Functional Data Analysis: Theory And Practice
  • Z. Q. Lu
  • Mathematics, Computer Science
  • Technometrics
  • 2007
The present book applies kernel regression techniques to functional data problems such as functional regression or classification, where the predictor is a function and nonparametric statisticians should feel very much at home with the approach taken in this book. Expand